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Introduction 


In recent decades, research and practice have shown that investing in a positive 
school-wide social culture is a key component of effective education. Evidence 
demonstrates that educators and students succeed when students are present, 
engaged, socially secure, and academically successful. Furthermore, the documented 
negative effects of student problem behavior! (both short-term and long-term) have 
prompted significant new efforts in prevention and remediation. Student behaviors 
that disrupt or detract from classroom learning can result in fewer learning 
opportunities for students, impaired relationships between students and teachers, 
deteriorating classroom and school environments, and decreased likelihood of 
academic success. 


An estimated 10 to 33 percent of students exhibit disruptive behaviors that are difficult 
for teachers to manage and that subsequently interfere with the ability of all students 
in a classroom to fully engage in instructional activities.? Without sufficient support, 
initial training, and coaching, teachers may be inclined to use punishment-based 
procedures, such as seclusion or exclusion, to manage disruptive behaviors. However, 
empirical research demonstrates that these punishment procedures, on their own,* 
are ineffective at reducing problem behavior over the long term‘ and undermine 
student-teacher relationships.° Furthermore, responding to problem behaviors with 
solely punitive approaches inhibits students from engaging in learning as well as 
learning how to positively change their behavior.® Compelling evidence also 
demonstrates the disproportionate use of punitive approaches with students of color, 
further contributing to academic and disciplinary opportunity gaps.’ 


Over the past two-and-a-half decades,’ policy developments, practical experience, 
and research have increasingly revealed the importance of investing in prevention, 
teaching prosocial and positive behavior, and reducing the rewards for problem 
behavior as approaches for both decreasing problem behavior and promoting 
prosocial and positive behavior among all students. Many schools and districts are 
implementing strategies or frameworks that focus on prevention and instructional 
practices to identify and support prosocial behavior. These practices typically involve 
stating expectations for behavior in a positive manner; clearly and openly teaching, 
modeling, and reinforcing these expectations; and using data to monitor and measure 
the effectiveness of these practices and adjusting the practice, if necessary.° Although 
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these practices were originally intended for use at the student level, there is 
increasing interest in adopting systems-level prevention and tiered approaches or 
frameworks that encourage appropriate behavior at the whole-class or whole-school 
level and increase the likelihood of effective teaching and learning for all students.!° 
Prosocial and positive behavior (hereafter referred to as “prosocial behavior”) refers 
to students’ observable actions and interactions that promote academic and/or social 
success for students, peers, and educators. For example, prosocial behavior may 
consist of students following classroom rules and expectations, self-regulating their 
behavior, playing or working cooperatively, and attending to instruction. 


Developed by 2M Research in conjunction with an expert panel and informed by a 
review of evidence using What Works Clearinghouse (WWC) evidence standards, these 
practice recommendations for educators draw upon studies of whole-school or whole- 
class interventions" that support prosocial behavior in elementary school students, 
including students who are identified as having disabilities or who are at risk of 
identification for special education services. Moreover, these recommendations are 
based on research on promising interventions that show evidence of improved 
outcomes for student behavior, educator classroom management, and school 
environment. The panel offers elementary educators, administrators, qualified related 
service providers, and qualified school-based mental health practitioners” five specific 
recommendations for prevention-focused practices that promote prosocial student 
behavior and related outcomes (see Table 1 below). 


Who Might Find These Recommendations Useful? 


These recommendations are designed to be used by educators, administrators, 
related service providers, school-based mental health practitioners, and parents to 
promote prosocial behavior in elementary students. These audiences can use the 
recommendations to identify and implement whole-school or whole-class prevention- 
focused strategies that support prosocial behavior among students, support changes 
in instructional and discipline practices, and improve the climate and equity of school 
and classroom environments. Practitioners may also find the recommendations 
helpful for identifying whole-school or whole-class practices that are particularly 
effective for supporting students with disabilities or students who are at risk for 
special education services and may need more intense support.” Further, the 
recommendations may be of interest to administrators who wish to implement, at the 
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district or state levels, the organizational systems and supports necessary for accurate 
and sustained implementation of prosocial behavior practices across elementary 
schools. 


Finally, the evidence supporting the recommendations has the potential to promote 
conversations among researchers about the availability of rigorous research on best 
practices related to prosocial behavior strategies, as well as conversations about 
research gaps that should be addressed. 


Using Evidence to Develop the Recommendations 


The panel’s recommendations add to the existing body of literature and a previous 
WWC practice guide on classroom behavior management" by synthesizing the 
evidence supporting five recommendations on whole-school or whole-class practices 
to promote prosocial behavior in elementary schools. Each recommendation includes 
examples of strategies and how to implement them, guidance on how to overcome 
potential obstacles, and a summary of the research evidence that supports the 
recommendation. 


2M, in conjunction with the expert panel, Box 1. Study Eligibility Criteria 


created a systematic review protocol to Siuemplovediciccmparconteroupidesia 


guide the evidence search and review. e Included non-commercial, whole-school, or 

whole-class interventions seeking to promote 

prosocial behavior within elementary schools 

findings from eligible studies (see Box 1) ¢ Published in 2007 or later 

e Reported on one or more outcomes in the 
following domains: 


WWC-certified reviewers summarized 


that met the protocol’s evidence standards 


for consideration by the expert panel. 1. Student Outcomes: 
Figure B.1 of Appendix B summarizes the Student Engagement in School. 

oe : Compliant Student Behavior. 
number of studies identified, screened, and Srident Socal emovoncleincHonine: 
reviewed under the protocol. Primary School Academic Achievement. 


General Literacy Achievement. 
General Mathematics Achievement. 
2. Educator Outcomes: 
proximal and distal outcomes, as well as Educator Discipline Practice. 
Educator Instructional Practice. 
3. School Environment Outcomes: 
recommendations. Outcomes in student Classroom and School Climate. 
Classroom and School Equity. 


There is a marked distinction between 


how these outcomes informed the practice 


behavior, educator disciplinary and 
instructional practices, and school environment domains were designated as proximal 
outcomes on the basis that behavioral interventions would be most likely to directly 
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affect these outcomes over a shorter time period, as is the case in the studies reviewed 
for this guide. In contrast, academic achievement outcomes (including outcomes in 
domains of primary school academic achievement, general literacy achievement, and 
general mathematics achievement) were characterized as distal outcomes on the basis 
that behavioral interventions would be less likely to directly affect these outcomes in 
the short term but may affect these outcomes over time. Accordingly, the expert panel 
focused primarily on proximal outcomes for student behavior and educator 
disciplinary and instructional practices, as well as for the school environment, to 
develop the evidence ratings associated with each recommendation. Thus, the panel 
designated academic achievement outcomes as a secondary focus. Additional details 
on how these outcomes informed the reviews can be found in Appendix B, and 
information on how the outcomes informed the evidence ratings is provided in 
Appendix C. 


This guide draws on studies of whole-school or whole-class interventions to support 
prosocial behavior by elementary school students, including students who are 
identified as having disabilities or who are at risk of identification for special 
education services. The practice recommendations were informed by research on 
promising interventions with evidence of improved outcomes for students, educators, 
and school environments. 


The five recommendations from the panel are shown in Table 1, below. 


TABLE1: Practice Recommendations 


Practice Recommendations 


Recommendation 1. Implement school-wide procedures for defining, teaching, and acknowledging a 
small set (e.g., 3-5) of positive behavioral expectations. 

Recommendation 2. Implement school-wide procedures to ensure that consequences for problem 
behavior (a) prevent escalation, (b) interrupt and/or redirect problem behavior to expected 
behavior, and (c) minimize inadvertently rewarding problem behavior. 

Recommendation 3. Use coaching to support implementation of evidence-based instructional and 
classroom management strategies. 


Recommendation 4. Collect, summarize, and use fidelity and student outcome data at all levels for 
iterative decision-making and problem-solving by stakeholders. 


Recommendation 5. Implement the organizational systems needed to support the initial adoption 
and sustained use of effective practices with high fidelity. 
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The guide references specific interventions examined in the seven studies that were 
assessed as meeting WWC evidence standards and provided the evidence to inform 
the practice recommendations (see Table 2). Readers can refer to this table for an 
overview of these interventions. Recommendations 1 and 2 are supported by five 
studies. Recommendation 3 is supported by three studies; Recommendation 4 is 
supported by five studies; and Recommendation 5 is supported by two studies. The 
number of study participants ranged from 24 to 859 schools or 89 to 158 teachers. 
Although these studies were assessed as meeting WWC evidence standards and 
informed the evidence-based recommendations in this guide, it is essential for readers 
to know that the authors do not endorse any specific brand-name or named 
interventions or practices featured in the studies. 


TABLE 2: Overview of Studies Informing Practice Recommendations 


: : Recommendation 
Intervention Study # of Observations 9 3 415 
Double Check Bradshaw et al. (2018) 158 teachers ° ° 

Ottmar et al. (2013) 
Responsive Additional sources: wa cehosle ; 7 
Classroom Rimm-Kaufman et al. 
(2014) 
School-wide 
AuSnaance aad Berg (2018) 27 schools ° ° 
Truancy 
Intervention 
School-wide Positive | Bradshaw et al. (2010) 
Behavior Additional sources: 37 schools P - : : 
Interventions and Bradshaw et al. (2012) 
Supports (SWPBIS) Bradshaw et al. (2015) || 
SWPBIS Pas et al. (2019) 859 schools ° . . s 
Teacher Coaching 
and Formative Fabiano et al. (2018) 89 teachers * : 
Assessment 
Team-Initiated 
Problem-Solving Horner et al. (2018) 38 schools . ° 7 ° 
(TIPS) 
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Overarching Themes 


In developing the practice recommendations, the expert panel identified five 
overarching themes that cut across the recommendations that are outlined in this 
guide (see Table 3). These themes represent important issues or factors to consider 
when developing and implementing practices to promote prosocial behavior in 
elementary schools. The five themes are as follows: 


TABLE 3: Overarching Themes 


Overarching Themes 


Theme 1. Address educational inequities through a multifaceted approach to implementing culturally 
responsive practices. 
Theme 2. Focus on promoting a positive school-wide social culture by investing in authentic student, 
teacher, and family relationships. 
Theme 3. Foster authentic relationships with students and families through concerted efforts to 
understand all parties’ diverse perspectives and experiences on school culture. 
Theme 4. Focus on equity by using culturally sensitive and responsive practices and by adapting 
evidence-based behavioral and instructional support practices to fit the social culture of the school. 
Theme 5. Obtain buy-in from different stakeholders, including the principals, educators, and support 
staff. 


Theme 1: Address educational inequities through a multifaceted approach to 
implementing culturally responsive practices. 


A multifaceted approach to culturally responsive practices involves holding high 
expectations for all students, using a student’s culture and experiences to enhance 
their learning, and providing access to effective instruction and learning resources.'° 
Because single events or disconnected initiatives are unlikely to produce effective 
responses, the inclusion of explicit equity goals in school action plans can help guide 
efforts to address equity issues comprehensively. School action plans and policies 
should provide clear definitions and disciplinary procedures, replace punitive 
practices with instructional responses for addressing problem behavior, and include 
accountability for improving outcomes. Data offer an invaluable tool for examining 
equity issues within a multifaceted approach by providing an opportunity to measure 
the extent to which schools are operating within an equitable structure. Robust 
approaches to examining equity data involve identifying an existing team to examine 
disproportionality within discipline data and develop equity reports that monitor 
progress across various populations regularly. 
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Professional development of educators is another key component to addressing 
educational inequities within a multifaceted approach. Professional development 
involves initial training and ongoing coaching (Recommendation 3), which can be 
used to increase the use of culturally responsive practices that focus on cultivating 
student connections to curriculum, developing authentic relationships, adopting 
reflective thinking, engaging in effective communications, and acknowledging 
individual student cultures.” Furthermore, training on the theory of implicit bias in 
education, and coaching focused on behaviors associated with implicit bias, can 
improve educators’ implementation of effective strategies for increasing equity of 
school discipline and special education referrals.'* Professional development can also 
assist educators in neutralizing their implicit biases by identifying specific discipline 
situations that are more prone to implicit bias and by adopting strategies for 
responding in accordance with their values. It is important to acknowledge that one- 
time trainings are insufficient to disrupt implicit biases and foster cultural sensitivity. 
Instead, cultural sensitivity in educators requires their ongoing self-reflection, 
willingness to have difficult conversions with colleagues to improve practices, and 
deliberate actions to unearth and dismantle biases. 


The panel highlights the need for a multifaceted approach to implementing culturally 
responsive practices. This approach combines data systems for examining equity 
issues (Recommendation 4) with culturally responsive practices for addressing 
problem behaviors (Recommendation 2), and this approach integrates the 
implementation of organizational systems needed to support adoption and sustained 
use of culturally responsive practices with fidelity (Recommendations 3 & 5). 


Theme 2: Focus on promoting a positive school-wide social culture by investing in 
authentic student, teacher, and family’ relationships. 


A positive school-wide social culture reflects common values, beliefs, and 
expectations for behavior that create a school environment that is predictable, 
consistent, positive and safe for students, families, and educators. Developing positive 
and authentic relationships among educators, students, and families is a key 
component of building and sustaining a positive school-wide social culture. However, 
developing authentic relationships can be a challenging endeavor. It may require 
school personnel to invest substantial time and effort in forming relationships that 
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promote collaboration and problem-solving with students and families from a wide 
variety of backgrounds. Positive relationships arise from?° 


1) clearly defined and commonly held values, 

2) specific expectations defining appropriate and problem behavior for ALL 
involved, 

3) ahistory of behavioral consistency with values/expectations (for example, 
people doing what they say they will do), and 

4) a pattern in which the frequency of positive interactions exceeds the frequency 
of aversive interactions. 


Guidance is provided on promoting a positive school-wide culture by investing in 
authentic and positive relationships as integral to implementing school-wide 
procedures for behavioral expectations (Recommendation 1) and by investing in 
consequences for problem behavior (Recommendation 2). 


Theme 3: Foster authentic relationships with students and families through concerted 
efforts to understand all parties’ diverse perspectives and experiences on school 
culture. 


Brief, reliable, and validated tools such as the U.S. Department of Education’s School 
Climate Surveys can be used to measure student, teacher, administrator, and family 
perceptions of school climate; such measurements can inform subsequent approaches 
to building positive relationships that support a collaborative approach to preventing 
behavior problems.” Approaches to developing and strengthening student-teacher 
relationships may consist of instructional practices designed to increase learning 
opportunities and positive interactions” with students who have or are at risk of 
emotional or behavior disorders” or to develop emotionally supportive classroom 
relationships that support students in developing prosocial skills, cooperating with 
their peers, and recognizing that their teachers and peers care about them.* Such 
relationships may be especially important for students of color and may help to foster 
a more supportive learning environment.” Peer relationships among students can be 
strengthened through group formats and other methods that provide an opportunity 
for students to practice new skills with their peers such as cooperation, collaboration, 
problem-solving, perspective-taking, play skills, and emotional literacy.”° Finally, the 
development of strong family-school relationships requires treating family members 
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as equal partners in the decision-making, planning, and implementation of positive 
school-wide social cultural practices.”” Culturally responsive practices paired with 
multidirectional communication are pivotal in supporting and empowering family 
members to engage as equal partners in education.”® 


The panel provided guidance on understanding diverse perspectives on school culture 
by establishing multidisciplinary problem-solving teams that incorporate multiple 
perspectives (Recommendation 1 and 2) and by forming district or state leadership 
teams responsible for engaging diverse stakeholders (Recommendation 5). 


Theme 4: Focus on equity by using culturally sensitive and responsive practices and by 
adapting evidence-based behavioral and instructional support practices to fit the 
social culture of the school. 


Educational systems cannot be considered adequate until they are effective for all 
student populations,”° and equity-focused practices are an integral part of efforts to 
promote prosocial behavior. Educational equity is characterized as policies, practices, 
interactions, and resources that are representative of, constructed by, and responsive 
to all students so that each individual has access to and can meaningfully participate 
in high-quality learning experiences.*° 


When focusing on equity, it is important to consider that equity issues may manifest 
in several ways. For students who are not from a dominant culture, school 
environments may impart unintentional slights that devalue the student’s background 
and impair school connectedness.*! Although student populations are becoming 
increasingly diverse, only 21 percent of the teaching workforce in U.S. public schools 
are people of color.*? Few teachers are well-equipped to bridge cultural differences 
and implement culturally responsive and unbiased classroom practices 
independently.*? Furthermore, implicit biases, or the unconscious attitudes and 
stereotypes that may affect understandings, actions, and decision-making, can 
adversely impact the equity in how educators perceive and respond to behavioral 
problems.* Finally, disproportionality in school discipline is an enduring issue in 
which office discipline referrals, suspensions, and other forms of exclusionary 
discipline are disproportionately administered based on certain student 
characteristics, such as race/ethnicity or special education status. This 
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disproportionate use of exclusionary discipline subsequently increases these students’ 
risk of academic failure, referrals to special education, and school dropout. 


The panel brings attention to the need for focusing on equity and using culturally 
sensitive and responsive practices by leveraging cultural knowledge and norms to 
inform behavioral expectations (Recommendation 1), recognizing implicit biases and 
the need to implement school-wide procedures for teaching behavioral expectations 
and addressing problem behaviors in an equitable manner (Recommendation 2), 
and using coaching to assist teams with systematically implementing culturally 
responsive practices to enhance equity in school discipline practices 
(Recommendation 3). 


Theme 5: Obtain buy-in from different stakeholders, including the principals, 
educators, and support staff. 


Adopting whole-school or whole-class practices for promoting prosocial behavior 
depends on contextual factors*® at the individual, school, and macro levels (e.g., 
federal, state, and district policies). Obtaining commitment and buy-in from multiple 
stakeholders, such as administrators, educators, and support staff is a critical 
contextual factor that can foster or inhibit initial implementation processes and 
significantly impact the implementation quality of school-based interventions. Indeed, 
staff buy-in has been identified as a prominent barrier,** with acceptance and 
commitment?’ as key factors affecting both initial implementation and long-term 
sustainability.** Factors that can help secure buy-in include (1) building consensus that 
a need exists; (2) selecting practices with evidence-based effectiveness; and (3) 
demonstrating that the practices are feasible and can be implemented by most 
individuals under typical conditions and with reasonable resources. Practices that are 
time efficient address an identified gap in existing services, and practices that meet 
the diverse needs of all students are more likely to be seen as acceptable and generate 
subsequent buy-in.°*° 


Research has shown that support and buy-in from administrators at both the school 
and district level is one of the most important factors for the success of both initial 
implementation and sustainability.*° Administrative support signals to school staff that 
implementation will be supported by allocating the requisite resources (e.g., time, 
training, and incentives), communicating the associated expectations, and addressing 
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practices that may compete for resources.*!Administrators can help secure broad buy- 
in by actively supporting whole-school or whole-class prosocial practices, regularly 
attending and participating in team meetings, empowering teams to implement 
prosocial practices effectively and use data for decision-making, and routinely 
communicating that prosocial practices are a top priority.” 


Several tools and processes can encourage stakeholder buy-in by aiding with decisions 
about which practices to adopt and decisions about which practices demonstrate their 
utility at an early stage. Planning and implementation tools* can be used to guide 
practice selection and evaluation through assessment of the associated evidence, 
supports, and usability alongside simultaneous assessment of the extent to which 
practices under consideration align with population needs, fit, and capacity. Another 
way to encourage buy-in is through pilot demonstrations, which may provide an 
important opportunity to demonstrate feasibility and effectiveness at an early stage 
and may provide the impetus for obtaining additional resources and support for large- 
scale efforts.*4 Cost-effectiveness analyses* can also be a critical tool for sustaining 
stakeholder buy-in, as such analyses compare the costs and outcomes of prosocial 
practices to other interventions (or the status quo) and demonstrate the benefits of 
improved outcomes and reductions in unnecessary costs. 


The panel provided guidance for obtaining buy-in from multiple stakeholders by 
establishing a representative, multidisciplinary team that can effectively engage 
diverse stakeholders to secure initial and sustained buy-in (Recommendations 1 & 
5), by providing staff and students with the opportunity to offer input on positive 
behavioral expectations and consequences for problem behavior 
(Recommendations 1 & 2), by using coaching to foster educator buy-in to the change 
process (Recommendation 3), and by using data to demonstrate progress and 
celebrate successes (Recommendation 4). 
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How to Use This Guide 
For each of the five recommendations in this guide, we include the following: 


e Recommendation: Details about the recommended practice, example 
strategies, and how the recommended practice supports positive behavior for 
all students. Appendix C contains detailed information on the individual 
studies that support each recommendation. Each recommendation also 
includes a “Spotlight on Implementation” that provides additional 
implementation details from one of the studies that supports the 
recommendation. 

e How to Carry Out the Recommendation: Guidance on how to implement 
the recommended practice. This guidance is informed by the studies that 
support the recommendation and the expert panel’s expertise and knowledge 
of resources and strategies available to help implement the recommendation. 

e Potential Obstacles: Panel advice about challenges and solutions to overcome 
them. 

e Tools and Resources: Supporting examples related to the guidance on how to 
carry out the recommendation. 


The guidance on how to carry out each recommendation is presented in a sequence of 
steps. However, not every step will be appropriate for every audience, nor will every 
step be required to implement a recommendation successfully. Recommendations 1 
and 2 focus on implementing school-wide procedures to teach positive behavioral 
expectations and ensure effective and equitable consequences for problem behavior. 
Recommendations 3 and 4 focus on using coaching and data to support 
implementation and iterative decision-making and problem-solving. 
Recommendation 5 focuses on implementing the organizational systems needed to 
support the adoption and sustained use of prosocial behavior practices with fidelity. 


Users of this guide are encouraged to apply the advice provided here in ways that best 
fit users’ varied work contexts. Though this guide does not provide step-by-step 
instructions for implementation, readers will find resources mentioned throughout 
the guide that provide more details about how to apply particular practices. 
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RECOMMENDATION 1: Implement School-Wide Procedures 
for Defining, Teaching, and Acknowledging a Small Set 
(e.g., 3-5) of Positive Behavioral Expectations. 


Educators, administrators, related service providers, and school-based mental health 
practitioners can proactively address students’ social, emotional, and behavioral 
needs by establishing a school climate that is predictable, consistent, positive, and 
safe. A positive school climate can be developed in part by teaching and rewarding the 
enactment of a small set (e.g., 3-5) of positive behavioral expectations. Behavioral 
expectations should be observable, measurable, positively stated, understandable, 
always applicable, and aligned with schools’ and greater community’s cultural 
standards.** The cultural knowledge and norms of the community, educators’ prior 
experiences and frames of reference, and the learning styles of culturally diverse 
students can be used to develop up to five behavioral expectations that are 
contextually relevant and effective for a school’s staff and students. 


Establishing behavioral expectations is best done early in the school year through 
explicit teaching using the same basic instructional model used for teaching academic 
skills (see Figure 1.1). Specifically, educators should teach, model, and practice each 
expectation across a representative group of at least three different settings (e.g., 
cafeteria, classroom, playground, hallways, and restrooms) and should use positive 
and negative examples so that students understand the difference between 
appropriate and problem behavior and actions. In addition, students should also 
receive feedback on such actions during planned practice opportunities. The expert 
panel recommends that, for students to learn the language, contexts, and behaviors 
that make school-wide expectations effective, educators should rely on direct teaching 
and ongoing review of behavioral expectations. After the beginning of the school year, 
when educators teach behavioral expectations through adult modeling, they should 
briefly review the expectations daily for the first few weeks of school and on an 
ongoing basis, with strategically timed booster sessions. For example, booster sessions 
should be held at least monthly and after every school break and holiday.*’ 


The educator should focus on recognizing and acknowledging students’ positive 
behavior often by explicitly restating students’ appropriate behavior and consistently 
showing approval for such behavior in typical school contexts. For example, 
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educators can use practices that turn the review of expectations into a quick and fun 
strategy to efficiently prompt, encourage, and acknowledge students for following 
appropriate classroom expectations.* In addition, all school staff, including 
educators, administrators, related service providers, school-based mental health 
practitioners, and parents can work together to positively recognize, acknowledge, 
and reinforce appropriate behavior in students. Acknowledging appropriate behavior 
can expand the precision and generalization of students’ acquired skills and may 
increase the opportunities to learn new and alternate ways of being appropriate in 
different setting. 


FIGURE 1.1: Basic Teaching Model for a Small, Manageable Set of Positive 
Behavioral Expectations 


Basic Teaching Model 


Supervise, 


MODEL with clear ACKNOWLEDGE, 
examples and reinforce,and 
nonexamples reteach 
DEFINE PRACTICE ADJUST instruction 
simply Qe multiple examples Oo based on progress 
in natural settings 


SOURCE: Adapted from Sugai et al. (2015). 


Recommendation 1 was informed by five studies of interventions with school-wide 
procedures for positive behavioral expectations. Two studies meet WWC group design 
standards without reservations,*® and the other three studies meet WWC group design 
standards with reservations.” In all five of the studies used to support 
Recommendation 1, establishing school-wide procedures for positive behavioral 
expectations was a major component of the tested intervention. 


The panel has a high degree of confidence in the research suggesting that 
implementing school-wide procedures for positive behavioral expectations is an 
effective practice. Recommendation 1 was predominantly derived from studies 
that meet WWC group design standards with reservations. See Appendix C for 
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descriptions of the intervention features and findings from each study informing 
this recommendation. 


How to Carry Out the Recommendation 


This section describes strategies, examples, and tools that can be used by educators to 
support effective implementation of school-wide procedures for defining, teaching, 
and acknowledging a small set of positive behavioral expectations. These positive 
behavioral expectations can be developed by school administrators, educators, 
related service providers, and school-based mental health practitioners, in 
partnership with students, their families, and community stakeholders. All figures and 
mentions of specific strategies in Recommendation 1 are offered as examples only 
and should not be read as endorsements of specific approaches or products. 


The guidance below is informed by the studies that support Recommendation 1, as 
well as the expert panel’s expertise and knowledge of resources and strategies 
available to help implement the recommendation. 


FIGURE 1.2: Steps to Implement Recommendation 1 


Create a Multidisciplinary Representative Team to Lead Implementation 


Define a Small Set of Positively Stated Behavioral Expectations with Input 
from Various Stakeholders 


Develop a System for Initial Teaching, Modeling, and Practicing of Behavioral 
Expectations Across School Settings 


Develop a System for Recognizing, Acknowledging, and Reinforcing 
Appropriate Behavior 


Develop a System for Monitoring and Adjusting Behavioral Expectations 
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1. Create a Multidisciplinary Representative Team to Lead Implementation 


This team aims to provide leadership for developing, implementing, and sustaining 
the positive student behavioral expectations that promote a positive learning 
environment. To achieve the team’s purpose of efficiently and effectively engaging 
diverse stakeholder groups to secure buy-in, the membership of the multidisciplinary 
team should represent the school. A multidisciplinary team of 5-10 people could 
include educators (including special education teachers), administrators, related 
service providers, school-based mental health practitioners, family members, and 
community members (e.g., business leaders, church leaders). Inclusion of a member 
of the family and community can ensure that the representative team reflects the 
school’s culture, especially the culture of underserved and diverse families. 


For example, the team could consist of a systems coordinator, a school 
administrator, a parent member, a school psychologist, and an educator staff who 
have expertise and knowledge of: 


a) applied behavioral techniques, 

b) coaching, 

c) student academic and behavior patterns, 

d) the operations of the school across grade levels and programs, and 
e) the community the school serves. 


FIGURE 1.3: Primary Responsibilities of the Multidisciplinary Representative 
Team 


e Hold monthly, onsite team meetings to plan and coordinate school-wide behavior 
systems (see Team Initiated Problem Solving [TIPS] training manual for conducting 
effective meetings). 

e Plan activities for implementing recommended practices (such as updating 
teaching curriculum, booster lessons of expected behavior, and 
acknowledgement assemblies). 

e Continually monitor and adjust expectations of behavior. 

e Attend district-wide meetings, training, and coaching to promote the continued 
development and maintenance of the recommended practice at your school. 

e Present the behavioral and implementation data collected at staff meetings to keep staff 
up to date with current expectations; and receive input and feedback from staff. 


SOURCE: Adapted from https://www.wisconsinrticenter.org/school-implementation/build-leadership-team/. 
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2. Define a Small Set of Positively Stated Behavioral Expectations with Input From 
Various Stakeholders 


The expert panel suggests schools should identify and select 3-5 positively stated, 
easy-to-remember school-wide expectations that define success for all students. These 
behavioral expectations should be consistent with the school’s effort to create a 
positive school environment and should align with the school’s mission. These school- 
wide expectations can be used as guiding principles that are: 


a) broad constructs or classes of behavior, 
b) positively stated and brief, and 
c) comprehensive. 


In other words, these principles allow anyone to address all behaviors by referencing 
one of the expectations.” 


For example: Be respectful, Be responsible, Be safe, Be kind, and Be cooperative. 


In addition, schools may wish to explore easy-to-remember catchphrases or assign 
names to these 3-5 school-wide expectations. If anyone walks into the school at any 
time and asks 10 random students to name the school-wide expectations, at least 80 
percent of the time, those students should be able to name the expectations and 
provide examples of what they look like in action. See this example of a poster 
below:*” 


Remember! The Golden Hawk says,’Be Respect{ut! Be Responsible! Be satel” 


Developing a matrix of specific behaviors/rules for clarifying each school-wide 
behavioral expectation across classrooms and settings can contribute to a common 
language for behavior in the school and a predictable, respectful, and safe experience 
for all (see Figure 1.4 for an example of a developed School Expectation Matrix). The 
multidisciplinary team should be sure to clearly describe procedures for each of the 
school’s non-classroom settings (e.g., hallways, cafeteria, school playgrounds, 
restrooms). 
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2a. Input from various stakeholders (principals, educators, related service providers, 
school-based mental health practitioners, students, and families) 


Creating partnerships with all stakeholders (principals, educators, related service 
providers, school-based mental health practitioners, students, families, and the 
community) is a critical component to consider throughout the implementation of 
this recommendation. This partnership should be built on the concept that schools 
(staff and students), families, and communities all share the responsibility for student 
learning and success. All need to have a shared vision for what learning and success 
should look like and how best to achieve both.* As the multidisciplinary team 
implements this recommendation, the expert panel suggests developing explicit plans 
for how to engage and involve ALL stakeholder partners so that they can be a part of 
the decision-making process in the school. 


FIGURE 1.4: An Example of a School Expectation Matrix 


Specific 
Behavior(s) 
and/or 
Procedures 


* Wait in line 
for your turn 


SOURCE: Adapted from https://www.pbis.org/resource/expectations-matrix-poster. 
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3. Develop a System for Initial Teaching, Modeling, and Practicing of Behavioral 
Expectations Across School Settings 


Establishing behavioral expectations is best done early in the school year. The expert 
panel recommends that for students to learn the language, contexts, and behaviors 
that make school-wide expectations effective, educators should rely on direct teaching 
and ongoing review of behavioral expectations. The multidisciplinary team should 
decide how all students will learn the expected academic and social behaviors across 
school settings. The panel also recommends that the school-wide rules, behavioral 
expectations, and routines be clearly defined, then taught to students at major school 
locations within the first few weeks of the school year’s start, with ongoing 
reinforcement through interacting with students in naturally arising situations each 
day (see example of “Be respectful,” “Be responsible,” and “Be safe” in Figure 1.4).* 


Teaching should include adult modeling and demonstrating, providing opportunities 
to practice and offer feedback, and—most importantly—providing praise or 
acknowledgement (and appropriate reward) for students’ effort (see Figure 1.5 for 
suggested details on how to get started). The expert panel recommends trainers and 
coaches focus most of the initial training on strategies that educators can use to teach 
behavioral expectations, including the strategies shown in Figure 1.6, developing 
written lesson plans.** Teaching strategies to educators ensures that staff show 
improved consistency in enforcing school behavioral expectations. Before receiving 
consistent information about teaching strategies, staff often have different 
expectations about what behavior is acceptable in different settings, which can lead to 
confusion among students. Importantly, educators should plan to hold periodic, 
scheduled booster lessons to help students maintain behavioral expectations over 
time. These booster sessions are especially important to hold after students return 
from long breaks, during times of the year when educators anticipate having more 
behavior issues, or when specific behavioral areas continue to be challenging. In 
addition, communicating the expected behaviors publicly in posters, school 
newsletters, local media, announcements, and assemblies can be valuable. Schools 
seeking more information may wish to explore resources from the Missouri School- 


Wide Implementation Workbook, such as their toolkit that offers more in-depth 
guidance to teaching expected behavior, and the PBIS Resource Tool Website that 
includes Suggested Scripts for Teaching and Reviewing Procedures. 
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FIGURE 1.5: Getting Started Teaching Behavioral Expectations 


(1) Create lessons for your 


school-wide expectations and 


non-classroom areas. 


(2) Develop a teaching schedule. 


(3) Assist all staff and 
stakeholders to (a) understand 
the importance of teaching and 


monitoring social behavior and 
C(o) re (aie) Koyo ai(emertorte(amcomncr(ert 
and monitor social behavior. 


specific behavior or 


re-teach 

e Assess the quality of your 
lessons by using the 
appropriate Artifacts Rubric 
available 


consensus 
e Distribute to staff in writing; 


website 


e Include expectation, include 


procedure, give context, tell, 
show, practice, monitor, and 


e Consider full staff input: obtain 


included in staff handbook or 


Follow a perpetual calendar 
Create at the beginning of the 
year or orientation 

Assess the quality of your year- 
long teaching schedule by 
using the appropriate Artifacts 
Rubric available 

Plan for ongoing teaching and 
review (e.g., monthly themes, 
review, or booster sessions) 


e Know how to conduct lessons 
e Use common language 


SOURCE: Adapted from 2019-2020 Missouri SW-PBS Tier 1 Implementation Guide (Missouri Schoolwide Positive 


Behavior Support, 2019). 
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FIGURE 1.6: An Example of an Initial Teaching Lesson Plan for Following 
Directions in All Settings 


Acknowledge 


Example Elementary Lesson: Following Directions 
(Initial Teaching For Acquisition) 


Specific Behavior({s) and/or 
Procedures 
List behavior and steps to complete. 


Context 
identify the location[s) where behavior is 


meroduce the behavior and explain why it is 
important 


Demonstrate or model the behavior, then 
model non-examples. 


Practice 
Give seudents opportunities to roleplay the 
behavior across all relevant secrings. 


ee 


> 


BFound, scan studencs, and 


pserve student performance and 
give positive feedback to students. 


Praceice throughout the day. 


Following directions means: 


Examples 


Keep eyes on teacher 
Do what the teacher asks 
Raise hand for help 


“Today we are going to review the skill ‘I can follow directions.” Read the behavior 
and steps. 

Brainstorm with the class a list of adults that students encounter on any given day at 
school. These adults may include their own teachers, specialists, P.E. coaches, 
secretaries, media specialists, lunchroom workers, bus drivers, custodians, and 


An adult blows the wide on the ee All paras stop playing and look to 
see that the path to their line-up spot is clear, Then, students move, keeping their 
hands and feet to themselves in their line-up spot. 

The teacher directs the class to push their chairs in and line up. The class politely 
pushes in their chairs and forms a line. Stadents join the line in order and leave space 
for others to get in line, Students make it to their class on time. 

Teacher models the non-example: Teacher has students roleplay being the teacher. 
Students give directions to get materials out for a lesson, and teacher does not 
comply. 


Give a direction, such as “clear your desk,” and time students to see how quickly they 
comply. 

“Simon Says” game: Practice with this follow-the-leader game to reinforce compliance 
with directions, 

Have students roleplay procedures such as lining up at the end of recess. Assign one 
student to be the “supervisor” and ask that child to verbalize the positive behavior 
they notice, 


"Before { give the next directions, let's review the steps to following directions, They 
are ‘listen attentively, raise hand to speak or ask questions, and begin task 
immediately.” 


"Thank you for following the fire drill expectations and safely exiting the building,” 
“Great counting off quickly and moving to numbered corners. That shows responsible 
use of our learning time, | heard some interesting discussions. Then, describe the 
interesting discussions you heard.” 


Have students share examples of when they promptly followed directions. 

Share examples of someone you saw promptly following directions. Tie that student's 
compliance to a positive outcome, such as having more time for recess because the 
class lined up in a timely fashion. 


SOURCE: Adapted from 2019-2020 MO SW-PBS Tier 1 Implementation Guide and Materials from Midwest PBIS 
curriculum for Tier 1 PBIS implementation (Missouri Schoolwide Positive Behavior Support, 2019). 
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4. Develop a System for Recognizing, Acknowledging, and Reinforcing Appropriate 
Behavior 


The expert panel recommends that schools establish a consistent system of 
immediate, intermittent, and long-term enforcement, monitoring, and reinforcement 
of positive behavior. This system should consist of all adults in the building positively 
acknowledging students’ appropriate behavior to enhance the teaching of rules and to 
maintain patterns of desired behavior school-wide.*’ 


Positive acknowledgement creates a rapport between educators and students, 
supporting students’ more frequent use of the expected behavior (see Figure 1.7 for 
examples and non-examples). This positive acknowledgment can be verbal; tangible, 
such as rewards or incentives; or a combination of the two. An example of reinforcing 
appropriate student behavior by granting students rewards or privileges might be 
allowing a student to be first in line, giving a student extra free time, or designating a 
student to be class helper. For example, reinforcement and acknowledgement systems 
may include school-wide verbal and non-verbal social praise or token 
economies/currencies that are visual and tangible and that are delivered by all adults 
in the school. These tokens may be part of a continuum that leads to privileges or 
weekly drawings for students—and educators—for acknowledgement. Implementation 
of these school-wide procedures should contextually fit the school improvement plan 
and specific discipline needs. The expert panel recommends that appropriate 
behavior should be acknowledged at least four times more often than problem 
behavior (at least 4:1 rule of acknowledgment and corrective feedback) to create a 
positive classroom environment.** Schools seeking more information can review 


resources developed by Vanderbilt and the Tennessee Department of Education on 
why behavior-specific praise works. 
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FIGURE 1.7: Examples and Non-Examples of Specific Praise for Expected 
Behavior 


Ben) Step 1: Identify the student or group 
Examples: Non-examples: 


ie) Step 2: Include a term of praise 


Q Step 3: Describe/acknowledge specific 
behavior/rule being recognized 


Step 4: (Best practice): Link to school-wide “This whole table group 
p cleaned up their lab area 
Sapeceinon when the period bell 
rang. Well done! Way to 
Step 5: (Optional): Provide tangible show ‘Responsibility-” 


4 reinforcement, reward, ticket, etc. 


SOURCE: Adapted from 2019-2020 Missouri SW-PBS Tier 1 Implementation Guide (Missouri Schoolwide Positive 
Behavior Support, 2019). 


5. Develop a System for Monitoring and Adjusting Behavioral Expectations 


The expert panel recommends an iterative process for determining how successful a 
school is at implementing the above-recommended practice and guiding plans to 
continue, sustain, or improve that initial success. An important part of the iterative 
process is to use fidelity tools that can be tailored to assess how faithfully the school 
staff are implementing the recommended practice relative to its original focus for 
each setting. Fidelity of implementation can be measured through an external 
evaluator or through educator self-assessment. Table 4 in Recommendation 4 
provides details on six valid and reliable implementation fidelity surveys, which are 
widely available, to assess school-wide implementation of behavioral expectations. 
The process of using implementation fidelity data to make decisions is also discussed 
in greater detail in Recommendation 4. Schools seeking more information may wish 
to explore resources from PBIS Assessment, such as their web-based application that 
assists in high fidelity and sustained implementation of behavioral interventions and 
supports at the school level, as well as Mercer et al. (2017). 
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In a continuous improvement cycle, multidisciplinary teams should plan to 
periodically evaluate the degree to which their vision statement remains true to their 
ideals and the degree to which their design remains aligned. At any point, teams may 
engage in an amendment process to adjust their strategies for implementing 
behavioral expectations. 


Potential Obstacles and the Panel’s Advice 


OBSTACLE: Building a positive school-wide social culture requires active involvement 
of most adults in the school. If the school principal and the majority of educators and 
staff do not support the effort, then establishing a positive school-wide social culture 
will be challenging. 


PANEL'S ADVICE: Taking time to determine whether a behavioral problem exists in 
the school will greatly improve adopting and sustaining recommended solutions. 
Once the staff agree to the “parameters” of the solution, selecting and launching 
professional development efforts by the multidisciplinary representative team will 
ensure staff’s sustained commitment to enforcing and reinforcing recommended 
“solutions” without resorting to punitive and exclusionary methods of discipline. 
Before selecting and implementing new school practices, educators should review the 
Hexagon Tool guidance developed by National Implementation Research Network, as 
illustrated in Figure 4.5 and discussed in Recommendation 4, to assess the fit and 
feasibility of potential practices. For the recommended practice to be truly beneficial, 
at least 80 percent of educators and administrative staff must buy in.*° 


The panel encourages schools to carefully review their processes to identify and 
improve staff buy-in. The following steps may be used to set up processes for 
implementing new practices. 


1. Use existing data on office referral, attendance, suspension, expulsion, or 
educator reports to determine whether students’ social behavior is of broad 
concern in the school (see Recommendation 4 for more details). This existing 
problem should be described through concrete facts and examples. 


2. Obtain staff agreement that any new efforts to improve social behavior will 
a. be empirically supported, 
b. be practical for use in the current school, 
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c. build on the effective behavior support practices already used in the 
school, and 

d. focus on the smallest changes that produce the largest improvement for 
students. 


For example, the multidisciplinary representative team may use staff meetings, 
quick surveys, or a drop-box to involve and ascertain staff input on critical parts of 
the implementation of the recommended strategy. 


3. Establish a representative team to define a strategy for establishing a positive 
school climate and ensure that the team has both the responsibilities and authority 
to be successful. 


To gain support, the multidisciplinary team can highlight how the recommended 
strategy employed can reduce disruptions and increase student engagement and 
instructional time, thereby making an educator’s tasks easier and improving 
satisfaction among staff. 


4. Install the data systems, teaming systems, and reporting mechanisms 
needed for effective implementation of the recommended strategy (see 
Recommendation 5 for more details). 


To obtain principal buy-in, see Figure 1.8 for strategies that include underscoring 
similar and nearby schools’ success stories to show the impact of the 
recommended practice(s). 


5. Obtain the professional development training and ongoing coaching needed 
to implement multitiered behavior support effectively (See Recommendation 3 
for more details). 


Buy-in should be secured from senior administrators, staff, and district leadership 
to support professional development and coaching efforts in the school. 


6. Implement the recommended strategy. 


Staff buy-in can be obtained by highlighting positive changes early and frequently 
and by recognizing staff who implement the recommended strategy with fidelity. 
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Incentivizing staff through various acknowledgments and “shout outs” could 
further ease the transition to using the recommended strategy. 


7. Review data collected on fidelity of implementation and student outcomes and 
modify the recommended strategy as necessary (see Recommendation 4 for 
more details). 


FIGURE 1.8: What Does Principal Support Look Like? 


Five Factors That Increase 


Presence of Principal 


Absence of Principal Support Likelihood of Principal 
Support 
Support 
e Allocate resources (teacher |e Understanding of PBIS 1. Innovation must be 
training and support, across staff at a low perceived to solve the 
funding) conceptual level problem 
e Highlight priority to staff e Planning time shortage 2. Compatible with one’s 
(time at staff meeting, e Balancing competing beliefs, values, prior 
presentations to family, initiatives becomes difficult experience, and needs 
community, board, e Dependence on technical 3. Key opinion leaders must 
website, back to school assistance increases support the innovation 
letter) 4. Initially implemented ona 
e = Make evident in hiring small scale before scaling 
practices up across grade levels 
5. Outcomes of the innovation 
are visible 


SOURCE: Adapted from McIntosh et al. (2016). 
OBSTACLE: Sustaining fidelity of implementation over time. 


PANEL'S ADVICE: Fidelity of implementation is essential for successful 
implementation and sustainability over time. A school-wide focus on specific desired 
behaviors can only be successful if staff agrees to recognize positive behaviors 
consistently and equitably. Monitoring implementation over time is important to 
ensure continued positive impacts from the recommended strategy and to ensure that 
implementation fidelity remains high. The panel recommends the following methods 
to sustain high fidelity of implementation. 


1. Implementation fidelity tools should be used to initially assess practices to 
determine adoption, assess initial implementation and sustain it, and assist in 
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designing action plans to improve implementation. The panel suggests ensuring 
that staff understand the importance of fidelity and what constitutes 
implementation fidelity. Schools implementing Recommendation 1 can use several 
surveys described in Table 4 in Recommendation 4 to measure how well they 
implement systems to improve student behavior. The panel recommends that the 
multidisciplinary team take the Tiered Fidelity Inventory (TFI) to measure baseline 
fidelity, but other measures such as the Self-Assessment Survey (SAS) could be 
employed depending on the resources available. 


The panel suggests having a designated person summarize data on 
implementation fidelity, highlighting successes and areas for improvement 
when reporting during faculty or multidisciplinary team meetings. 


. The panel recommends that the organizational system should be updated to 
require schools to collect and report implementation fidelity data 
regularly. 


For example, a district requirement for sustained use of fidelity checks will ensure 
data are collected and reported. In addition, coaches can support and encourage 
data collection and motivate implementers to reflect on their practice, and if 
appropriate, identify areas of strength and those that could be improved. If 
necessary, coaching can also help to reexamine and adjust behavioral strategies 
being implemented to ensure that the critical elements of the recommended 
practices and school strategy are being implemented as desired. 


. Districts can acknowledge school multidisciplinary teams once a year for 
meeting the threshold for implementation fidelity and the fidelity progress made 
over time. 


For example, districts or states can create a system to recognize high 
implementation fidelity, in which schools that exemplify high fidelity and 
consistently maintain high fidelity are celebrated and allowed to share their 
success stories of implementation with other schools and districts. The State of 
Maryland uses tiered levels of recognition based on implementation and outcomes 
to encourage high implementation fidelity: 


Promoting Social and Behavioral Success for Learning in Elementary Schools 27 


a. Bronze - to recognize schools in the early stages of implementation 

b. Silver - to recognize schools that are implementing with fidelity 

c. Gold - to recognize schools that are implementing with fidelity and have 
evidence of improvement in student outcomes 


OBSTACLE: Staff might feel overwhelmed by the extra work created for updating 
lesson plans and responding to appropriate behaviors. 


PANEL'S ADVICE: Proper planning of implementation can help prevent staff from 
becoming overwhelmed during implementation of new practices. The panel suggests 
the multidisciplinary representative team follow the “stages of implementation” 
described in Recommendation 5. Additionally, the panel recommends integrating 
the recommended practices with the school’s existing practices and communicating 
the practice through a simple and easy-to-follow framework (e.g., an expectation 
matrix or detailed lesson plans). These actions will help staff understand that their 
initial investment of time and effort during the start-up phase will result in orderly 
behavior throughout the year. Clear, quick, and demonstrable improvements in 
student behavior will also reduce staff’s reluctance to implement recommended 
practices. If implementers are unable to show staff these additional benefits, the panel 
suggests obtaining more educator support by finding tangible ways to lessen 
struggling educators’ teaching load, rotate shared responsibilities, or reduce non- 
teaching burden. Multidisciplinary representative team members can help reduce 
staff stress by being positive and supportive, listening to concerns, and collaborating 
to find innovative solutions. Finally, incorporating these responsibilities into job 
descriptions will ensure successful onboarding that makes expectations clear to new 
educators and staff from the beginning, especially if the school has a high staff 
turnover rate. 


OBSTACLE: Students receive clear messages about what is expected and how to 
behave successfully across settings and situations in the school, but they may be 
unclear about how to respond when other students behave inappropriately. 


PANEL’S ADVICE: Once students have learned positive expectations, educators can 
teach an appropriate routine to students for how to behave if other students behave 
inappropriately. Building on the school-wide foundation of expected behaviors, all 
students should be taught a formal, predetermined routine for recognizing the signals 
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of problem behavior by peers and responding to such behavior. This routine should 
include (1) telling the fellow student who is behaving inappropriately that their 
behavior is inappropriate and needs to change; (2) stepping away from the student 
who is misbehaving; and (3) recruiting assistance from adults if the problem behavior 
continues. Teaching a specific routine for identifying and responding to peer problem 
behavior as a general approach to all students removes some students’ ability to use 
problem behavior (e.g., bullying, taunting, harassment, or intimidation) to get social 
attention or praise from peers. See the PBIS Bully Prevention Manual for more 
resources. 
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RECOMMENDATION 2: Implement School-Wide Procedures 
to Ensure that Consequences for Problem Behavior (a) 
Prevent Escalation, (b) Interrupt and/or Redirect Problem 
Behavior to Expected Behavior, and (c) Minimize 
Inadvertently Rewarding Problem Behavior. 


Student problem behavior can detract from instructional time and contribute to 
reduced student achievement, increased educator stress, and attrition.®° Educators 
have been taught to use and often rely on punishment procedures that undermine 
student-educator relationships and risk public shaming of students.*! These 
punishment procedures are proven ineffective at reducing problem behavior in the 
long term,” and the use of these procedures denies the educator an opportunity to 
use an instruction-based, proactive, and positive approach to teach expected 
behavior. Educators, administrators, related service providers, and school-based 
mental health practitioners can proactively address students’ social, emotional, and 
behavioral needs by establishing a continuum of preventive, consistent, predictable, 
and corrective consequences for discouraging problem behavior in classroom and 
non-classroom settings for all students. In turn, these consequences can help facilitate 
relationships that are foundational to teaching and student learning and success. 
Furthermore, using well-timed, positive, supportive, and consistent techniques to 
address problem behavior is essential to interrupting problem behavior and 
preventing escalation. Educators can view rule violations as corrective instructional 
opportunities to teach, practice, reinforce, and build student behavioral 
competence. 


For example, when students are talking too loudly during group work, the 
educator could respond, “Please respect others by using a quieter whisper voice 
while working with your partner.” 


These strategies will ensure increased probability of future expected behavior, 
providing the student a chance to succeed, reducing out-of-instruction time, and 
building constructive student-educator relationships and a positive learning 
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environment for all students. Educators who use the above strategies consistently 
tend to have the lowest rates of disruptive classroom behavior.® 


It is important to address and correct “minor” problem behaviors before they get 
worse; however, it is also helpful to remember that educators who wish to create a 
positive classroom environment should acknowledge appropriate behavior at least 
four times more often than problem behavior. Systematic, consistent, and fair 
discipline procedures are crucial to developing a successful system of consequences 
for problem behavior in the school—a system with disciplinary responses that are 
respectful to students and that focus on teaching appropriate behavior as often as 
possible. An earlier Institute of Educational Studies practice guide, the 2008 Reducing 
Behavior Problems in the Elementary School Classroom practice guide, provides some 


strategies that may still be relevant today to reduce problem behavior in elementary 
school students. 


Recommendation 2 was informed by five studies of interventions with school-wide 
procedures for ensuring consequences for problem behavior. Two studies meet WWC 
group design standards without reservations,” and the other three studies meet WWC 
group design standards with reservations.® In all five of the studies used to support 
Recommendation 2, establishing school-wide procedures for ensuring 
implementation of consistent and effective consequences for problem behavior was a 
major component of the tested intervention. 


The panel has a high degree of confidence in the research suggesting that 
establishing school-wide procedures for ensuring consequences for problem behavior 
is an effective practice. See Appendix C for detailed descriptions of the 
intervention features and findings from each study informing this 
recommendation. 


How to Carry Out the Recommendation 


This section describes strategies, examples, and tools that can be used by educators to 
support effective implementation of school-wide procedures for ensuring 
consequences for problem behavior. The consequences for problem behavior can be 
developed by school administrators, educators, and staff, in partnership with 
students, their families, and community stakeholders. All figures and mentions of 
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specific strategies in Recommendation 2 are offered as examples only and should not 
be read as endorsements of specific approaches or products. 


The guidance below is informed by the studies that support the recommendation, as 
well as the expert panel’s expertise and knowledge of resources and strategies 
available to help implement the recommendation. 


FIGURE 2.1: Steps to Implement Recommendation 2 


Create a Multidisciplinary Representative Team to Lead Implementation 


Develop a System for Preventing Inappropriate Behavior 


Develop a Consistent System for Consequences for Inappropriate Behavior 


Develop a Process for Monitoring and Documenting Inappropriate 
Behavior and Adjusting Strategies to Correct the Behavior 


Define Problem Behaviors with Input from Various Stakeholders 


1. Create a Multidisciplinary Representative Team to Lead Implementation 


Usually, Recommendations 1 and 2 are implemented simultaneously. To avoid 
duplicating efforts, the panel suggests asking some of the questions as illustrated in 
Figure 2.2 if there is a need for creating a new multidisciplinary representative team. 
If implementing Recommendation 2 separately from Recommendation 1 or 
deciding to create a new team to reduce staff burden, school staff should follow 
procedures similar to those discussed in Recommendation 1 to create a 
multidisciplinary representative team. 
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FIGURE 2.2: While Assembling the Team, Ask the Following Questions: 


How will you ensure families and other stakeholders are represented to capture voice and choice from the | 
school community? 


SOURCE: Adapted from 2019-2020 Missouri SW-PBS Tier 1 Implementation Guide (Missouri Schoolwide Positive 
Behavior Support, 2019). 


2. Define Problem Behaviors with Input From Various Stakeholders 


While Recommendation 1 focuses primarily on the explicit instruction of behavioral 
expectations and positive reinforcement for meeting those expectations, 
Recommendation 2 emphasizes the need for consistent consequences to hold 
students accountable when they have difficulty meeting behavioral expectations. 
Educators need professional development and coaching to master the strategies and 
maximize their use of Recommendation 1 and effective responses to prevent 
problem behavior. In addition, the panel acknowledges that educators should reduce 
the need to refer a student to the office, particularly because sending a student to the 
office removes that student from the academic learning environment. Administrators 
should offer coaching for educators on how to prioritize effectively responding to 
student problem behavior within the classroom. Figure 2.3 is an example flowchart 
that a multidisciplinary representative team could use to systematically discourage 
problem behavior and prioritize the use of within-classroom educator response before 
a student is sent out of the learning environment. 


To implement Recommendation 2 consistently, educators first need to define 
“problem behavior.” Staff may have different ideas about what constitutes a problem 
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behavior and the appropriate response in terms of “minor” offenses managed by staff 
or “major” offenses managed by the office. To reduce confusion and frustration 
among staff and students, any behavior that disrupts the class and is not listed on the 
classroom rules and procedures matrix developed in Recommendation 1 can be 
deemed “problem” behavior. The multidisciplinary representative team can 
determine the problem behaviors that need to be office-managed through explicit 
definition of each behavior, which ensures all staff share a thorough understanding 
and use office referrals consistently.” 


Just as it is important for the multidisciplinary team to define major/office-managed 
problem behaviors, it is also important for the team to clearly define minor/classroom- 
managed problem behaviors. Usually, any behavior not explicitly stated to be office- 
managed behavior is expected to be classroom-managed minor unexpected behavior 
(see Figure 2.4). 


Once problem behaviors have been clearly defined as office- or classroom-managed, 
the multidisciplinary team should develop consistent written procedures for office 
referrals. Such written documents should clearly describe the procedures and develop 
staff’s thorough understanding of minor/major offenses, classroom-managed/office- 
managed behaviors, staff roles, and follow-up procedures during and after referral 
(e.g., resolution, possible consequences, data entry). These procedures should 
encourage teaching and office staff to implement an office discipline referral (ODR) 
consistently (each time a similar event occurs), equitably (with each student who 
displays the major unexpected behavior), and with fidelity (as the procedures are 
described in the written document). This process will require the team to develop an 
ODR form aligned with the expected behavior definitions and inclusive of all the 
essential items that need to be captured: who, what, when, where, how, and why (see 
Example of an Elementary ODR Form in Figure 2.5). 
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FIGURE 2.3: An Example Flowchart to Discourage Problem Behavior 


Ensure School-wide 


: - Office Discipline 
tive Major? 
— : z Referral (ODR) and 
Classroom Practices anes teieac 
Are Implemented with Problem Behavior, Office-Managed? PPO: 


Planning 


Fidelity Occurs 


Minor? 


Classroom-Managed? 


| 


Indirect Strategies: eravey ae 
* Proximity omar 


Signal/Nonverbal Cue =x 


Praise/Positive Feedback 
Increase pre-corrects 


Behavior Increases in 
Frequency 


| 


Direct Strategies: 
Redirect 


Reteach Behavior Intensifies to 
Provide Choice 


amajor ODR 


Conference* (document) 

Consider Family Contract === 
Restitution 

Intensify the Effective Teaching 


Behavior Increases in 
Frequency 


Behavior Intensifies to 
Assistance From: amajor ODR 


Families (continued) 


Student Assistance Team 
(Future Tier 2 Team) 


SOURCE: Adapted from 2019-2020 Missouri SW-PBS Tier 1 Implementation Guide (Missouri Schoolwide Positive 
Behavior Support, 2019). 
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FIGURE 2.4: An Example of Defined Classroom-Managed Problem Behaviors 


Minor/Classroom-Managed 


Defiance, Disrespect, Brief or low-intensity failure to respond to adult 
Noncompliance requests 

Disruption Low-intensity but unexpected disruption 
Unexpected Language Low-intensity instance of unexpected language 
Physical Contact Non-serious but unexpected physical contact 
Property Misuse Low-intensity misuse of property 

Tardy Arrives at class after the bell 

Technology Violation Non-serious but unexpected use of technology 


SOURCE: Adapted from 2019-2020 Missouri SW-PBS Tier 1 Implementation Guide (Missouri Schoolwide Positive 
Behavior Support, 2019). 


Finally, engaging staff in selecting and defining these major and minor problem 
behaviors is critically important, especially if staff inconsistently refer minor problem 
behaviors to be office managed. To obtain staff buy-in, the multidisciplinary team may 
choose to allow staff to create lists of major or minor problem behaviors and to define 
the consequences, respectively. 


Once a final list of classroom-managed and office-managed behaviors and their 
definitions has been developed, the list should be distributed in staff, student, and 
family handbooks and should be made available on the school website. 


For example, to obtain staff buy-in, the multidisciplinary team can gather staff input on 
problem behaviors and the behaviors’ definitions by allowing staff to individually write a list 
of problem behaviors on a sticky note. Ask each staff to share all their sticky notes, 
eliminate duplicate behaviors between lists, and review the final list to add any problem 
behaviors that might be missing. Then, as a team, begin to define each problem behavior or 
use a volunteer work group to review staff’s sticky-note lists to draft a composite list of 
problem behaviors that all staff can review at a later date. 
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FIGURE 2.5: An Example of an Office Discipline Referral Form That Captures 
Essential Items of Problem Behavior 


Example 
Elementary Office Discipline Referral Form 
When 
Who <— Student nT IEP: Y of N (Date) 
Grades K12345 Time of incident: 
Classroom Teacher ...séReferredby 
Where please check) 
Restroo O Library OC Playground OHallway © Special event (field trip/assembly) 
OC Bus area OC Onbus O Cafeteria O Classroom OOther_ 
What <“REASON(S) FOR THE REFERRAL Please attach narrative of the incident if necessary.) 
SAFETY RESPECT RESPONSIBILITY 
Minor: Minor: 
O Physical contact O Defiance/disrespect/ OC Property misuse 
2 CO Other 
OC Physical aggression/assauit C Inappropriate verbal : 
o rassment language © Schoolwork/homework 
OC Danger to self or others O Disruption OC incomplete 
© Weapons Major CO Technology violation 
OC Other O Disrespect/non-compliance CO Possession of ilegal school 
o Ss 
O Verbal assauilt/threat © Other 
© Damage or destruction of 
property 
0 onl How Often— not on 
OOther this form, requires 
Why OTHERS INVOLVED: attention to pattern of 
Gon trom p © Avoid work C.None O Substitute multiple referrals 
C Attention from adult(s) © Obtain item O Peers 0 Unknown 
O Avoid peer(s) © Don't know O Staff O Other: 
O Avoid adult(s) OOther © Teacher 
TEACHER ACTION TAKEN PRIOR TO REFERRAL: 
OC Changed student's seat © Consulted Principal 0 Telephoned 
© Consulted Counselor 0 Time out in the classroom parent/guardian 
O Sent previous report home CO Met with Student © Other (Please specify) 
© Conterred privately with Assistance Team a ees 
Student 
ADMINISTRATIVE CORRECTIVE ACTION: 
© Counsetor referral O Time out in office O Individual instruction 
0 Out of school suspension © Loss of privilege OC Sent home 
(__. days) © Conference with student © Other 
© Agency referral O Restitution 
OC in-school detention O Parent contact 


PARENT CONTACTED: (Checkone) OCall OMal OMessage CEmail OConference 
COMMENTS: (Use back if needed) 


Teacher's Signature: Principal's Signature: 


SOURCE: Adapted from 2019-2020 Missouri SW-PBS Tier 1 Implementation Guide (Missouri Schoolwide Positive 
Behavior Support, 2019). 


3. Develop a System for Preventing Problem Behavior 


It is critical to remember the importance of prevention as a useful strategy for 
decreasing the likelihood of problem behaviors. The expert panel encourages 
educators, when student behavior becomes a consistent concern, to reflect on their 
use of preventive strategies that explicitly recognize and then acknowledge the role of 
internal, often implicit, biases when responding to students’ problem behavior. A 
preventive strategy that the panel recommends is to build positive student-educator 
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relationships, as these relationships have long been considered a foundational aspect 
of positive school experience. The Establish, Maintain, and Restore strategy” can be 
used as a framework for understanding educator-to-student relationships in three 
dimensions, as illustrated in Figure 2.6. Educators can use similar high-leverage and 
low-time investment strategies to reflect on their relationships with each of their 
students. In addition, educators can use these strategies to intentionally focus on 
students who exhibit problem behavior or to focus on students with whom educators 
are struggling to connect. These strategies can increase appropriate student behavior 
that fosters a better classroom climate and more academically engaged students. 
Recommendation 1 of the Reducing Behavior Problems in the Elementary School 
Classroom Practice Guide, published in 2008, provides additional strategies that can 
be used to prevent problem behavior. 


FIGURE 2.6: A Simple Framework to Build, Maintain, and Restore Positive 
Relationships With Students 


a 


Recommect with the student 
after a negative interaction to 


Keep relationships intact 
through ongoing positive 
interactions by: 


Teach social behaviors 


4:1 positive to negative 
interaction with 
students 
Demonstrating concern 


for student wellbeing 
by regularly asking how 
they are doing 
Acknowledging 
appropriate behavior 
often 


KR 


restore the relationship by: 


Starting again, if 
needed forgive 
Taking responsibility 
and show enrpathy 


Focusing on solutions 
and not the problem 
Separating the deed 
from the person 
Reducing personal 
biases for the students 


SOURCE: Adapted from https://www.swsc.org/cms/lib/MNO1000693/Centricity/Domain/124/Clay%20Cook%20- 
%20Creating%20nurturing%20and%20responsive%20envir onments%20handout. pdf. 


4. Develop a Consistent System for Consequences for Problem Behavior 


When students see rules applied fairly, they are more likely to behave appropriately. 
Generally, schools with (a) clear rules and reward systems and (b) businesslike 
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corrections and sanctions experience few problem behaviors because the 
corresponding responses to such behaviors are predictable for students. Students also 
learn over time that there are clear consequences for problem behavior. When rules 
are consistent, students develop a respect for rules and internalize beliefs that the 
system of governance works.” The panel recommends that the multidisciplinary 
representative team specifically lay out a consistent system that clarifies in detail the 
consequences for each problem behavior. For example, the multidisciplinary team 
may provide staff with guidance on how to provide consistent corrective 
consequences in response to problem behaviors:” 


1. Identify - Explicitly state the observed problem behavior and why it does not 
meet school-wide expectations. 

2. Redirect - Communicate precisely what the expected behavior should be (with 
possible input from the student[s]), quickly disengage at the end of behavioral 
correction by refocusing on the class (if needed), and try to pair with specific 
contingent praise after the student engages in appropriate behavior. 

3. Minimize - Reduce the likelihood of rewarding the problem behavior (e.g., 
paying too much attention to the student). 


The corrective consequences should be administered in a calm and respectful manner 
using a brief, concise, consistent, and informative statement in close proximity to the 
student to encourage compliance and build a strong relationship. An appropriate 
continuum of evidence-based strategies can be used to prevent, pre-correct for, and 
respond to problem behaviors to minimize disruption and decrease the likelihood of 
problem behavior in the future. These strategies include the use of simple (e.g., 
correcting problem behavior) and more complex (e.g., differential reinforcement) 
instructionally based strategies to respond to problem behavior.” Figure 2.7 provides 
some strategies that can be used to respond to problem behavior, and Figure 2.8 
provides an example of a progressive hierarchy of responses to problem behavior that 
an educator can administer. 


It is essential to use consequences that have educational relevance and reflect logical, 
developmentally appropriate, setting-specific responses to problem behaviors. In 
summary, educators should use appropriate consequences to help students change 
their problem behavior. Be sure to pair any additional corrective consequence with 
the teaching of expected behavior within an environment that has a significantly 


Promoting Social and Behavioral Success for Learning in Elementary Schools 39 


larger proportion of positive, specific feedback to corrective feedback (e.g., ratio of 4 
positives to 1 negative; Caldarella et al. [2020]). Educators seeking more information 


may wish to explore resources from a particular district’s PBIS handbook that 
provides examples of discipline procedures. 
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FIGURE 2.7: Continuum of Response Strategies to Problem Behavior 


A teacher's toolkit of practices organized by resource intensity, for responding to inappropriate 
What is behavior. Use the least intensive educational approach to support student learning and achieve 
it? demonstration of the appropriate skill. 


Practices are chosen by the Tier 1 team, added to the school's discipline flowchart, 
and installed and supported through professional development (PD). 


Sample Practices 
Team May Install 


Planned Ignoring cad acca 

Physical Proximity Using teacher proximity to communicate teacher awareness, caring, and concern 

Direct Eye Contact The "teacher look” to get attention and non-verbally prompt a student 
Signal/Non-Verbal Cue Teacher gestures to prompt a desired behavior or adherence to a procedure and routine. 
Praise the Appropricte Use Behavior Specific Praise with a different student or group to remind all students of 

Behavior in Others the expected rule/expectation. 

Redirect Restate the desired behavior as described on the teaching matrix 
Praise Approximations Reinforcing one behavior and not another. For example, praise the positive behavior 
(Differential Reinforcement) while ignoring the student’s inappropriate behavior. 
State and demonstrate the matrix behavior. Hisve the shadank damonsteate. Provide 


What Re-teach ERED REE 
does it Specific feedback that informs the student to stop the undesired behavior, and to engage 
look like? in the desired behavior connected to the school-wide expectation 

Specific Error 1. Respectfully address the student 


inappropriate 
Correction %: iescthe eunecied bubosiosfauke 


5. End with encouragement 
Strategies helping a student regulate, or “quiet” their stress response, relate to an 
empathetic adult, and reason to think logically. 
Give appropriate alternative choices to lead to the same target outcome. Examples: 
Provide Choice accomplish the task in another location, change the order of task completion, use 
alternate supplies to complete the task, or offer a different type of activity. 
Conkarence wii Season PR AES TE SS PPA AB A a a at 
Restorative Circe Inclusive circle format and processes to address specific incidents that have occurred, and 
conned Ipcaning fo ahest-aide expectotinns (Costello et: a, 2010) 


\Eiliecioheas sisiel gs Snel ith of Iealiasdionel teaclihigg shichigfies ie uinat dlienath Senciinis, tlikailiy, ead cates al 
inappropriate behavior. No single strategy will work for all youth or in all situations. 

Punishing problem behavior, instead of correcting through a positive, proactive, educative approad, is linked to increased 

aggressions, vandalism, truancy, and dropouts (Mayer & Sulzer-Zazroff, 1990; Skiba, Peterson, & Williams, 1997). 

Traumo- The continuum of response provides opportunity to use trauma informed strategies to help the student 

Lens? Sees, Comeiet Sette) SORES oe, oe aes Res Sete to ocean Sak pete eiieg es Comet. 


Regulate, Relate, Reason 


Why? 


if Sich ands of pascliena Ueda bin salah toy hn ae) Team, ond installed through ongoing PD. The toolkit should 
include 1) practices to address skill deficit (lock of a skill to perform a desired behavior), 2) practices to address 
performance deficit (lack of a motivation to perform the desired behavior), and 3) Error Correction os c universal 
corrective feedback process. 

Provide opportunities for self-ossessment, peer-observation, ond coaching to improve fidelity of the strategies. 

e Use the least resource intense practice possible to achieve the objective. Focus on consistency and patience in 

responding to behavior. 

Document the school-wide list of recommended practices in a discipline flow-chart. 

Response practices should communicate support, caring, and relationship building. 

Provide teachers PD on function of behavior to support selection of practice 

lt isnot: A list of punishments, nor a process for teachers to follow in order to reach a punishment; 

A public shaming response cost system (clip-charts, names on board, etc.) 

A privilege level system 


How? 


Tips? 


SOURCE: Adapted from Costello, B., Wachtel, J., & Wachtel, T. (2010) and 
http://www.midwestpbis.org/materials/classroom-practices. 
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FIGURE 2.8: Example of How to Use Continuum Response Strategies to a 
Particular Problem Behavior 


Hierarchy of supportive Example: A student is fiddling with objects on her 


consequences desk instead of beginning a writing assignment. 


The educator ignores the fiddling with objects 


Step 1: Differential behavior, provides specific praise to a peer who is 
reinforcement of alternative sitting close to the student and writing as instructed, 
behavior and provides positive reinforcement when the student 


stops fiddling with objects and begins writing. 

If the student does not begin writing, the educator 
encouragingly points to the student’s paper to prompt 
Step 2: Nonverbal reminder the student to begin writing or provides a visual cue 
such as a picture of the student writing or a cue card 
that reads, “Time to write.” 


If the student does not begin writing, the educator 
Step 3: Verbal reminder provides an encouraging verbal prompt such as, “It’s 
time to start writing.” 


If the student does not begin writing, the educator 
writes the first sentence for the student and asks the 
student what she can write next. The student states 
what she can write next, starts writing, and the teacher 
walks away, allowing the student to continue working. 
If the student does not respond to Steps 1-4 and begins 
escalating into emotional distress, the student goes to a 
predetermined safe space in the classroom to calm 
down. Once she has calmed, the student returns is sent 
to her desk to complete the writing activity. 


Step 4: Offer assistance or 
modify the task 


Step 5: Provide a safe space for 
de-escalation 


SOURCE: Leach and Helf (2016). 
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5. Develop a Process for Monitoring and Documenting Problem Behavior and 
Adjusting Strategies to Correct the Behavior 


As discussed, it is essential to provide The “Big 6” Questions About 
educators both with strategies to build Problem Behaviors 


positive relationships with all students and 


with skills to respond to problem behavior, ¢ Who are the students generating 


i ? 
which prevents escalation and classroom Penavior Proviens: 


e What types of problem 


disruption. However, it is also important : : 
behaviors are occurring? 


for educators to know the source of 
_ } e When are the problem 
remaining behavioral challenges and 


which students continue to be removed 


behaviors occurring? 
e Where are the problem 


from the learning environment for behaviors occurring? 

disciplinary reasons. e How often do the problem 
behaviors occur? 

School multidisciplinary representative © Why does the problem behavior 

teams may want to collect regular, keep occurring under these 

accurate, up-to-date disciplinary data and conditions? 


monitor the data to see any disparities 

among student groups. Please note that 

the procedures for using data are discussed in greater detail in Recommendation 4. 
After collecting data, teams can focus primarily on reviewing patterns of offenses like 
distracting the teacher or classroom, classroom disruption, and not listening to 
instructions, which usually comprise a large percentage of overall referrals and 
suspensions. These offenses are the ones that we can affect by providing professional 
development and ensuring consistency in educator response. 


To help find consistent problem behavior, multidisciplinary representative teams may 
seek to analyze their data to determine what offenses are prevalent, how often the 
offenses occur, where and when the offenses occur, who is involved, and what 
knowledge gaps about appropriate behavior exist among student groups. A clear 
understanding of the trends leads to educators identifying the causes (why does the 
problem behavior keep occurring under these conditions) of the disciplinary actions, 
which in turn provides information for school teams about how to intervene to 
decrease disruptions in student learning and to eliminate discipline disparities among 
student groups.” 
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School teams can review and use these data to guide decision-making for schoolwide 
and more targeted professional development, as well as refinements to school-based 
systems and practices, to increase the use of effective and efficient behavioral 
management strategies. Although functional behavioral assessments (FBAs) are widely 
recommended for use to manage behavior, there are clear indications that this 
evidence-based practice is not used regularly or reliably.“ Nevertheless, the core 
elements of FBAs that promote function-based thinking may help bridge this gap and 
serve as an efficient strategy to address behavior problems and inappropriate 
referrals.” Figure 2.9 illustrates how consequences can decrease problem behaviors 
and increase the likelihood that appropriate behavior will be repeated in the future. 
Educators seeking specific strategies for practical FBA and training methods designed 
for use with students who exhibit consistent behavior problems may wish to explore 
resources available at PBIS.org in addition to a case study illustrating how FBA can be 
implemented by general education teachers in Hershfeldt et al. (2011). 


FIGURE 2.9: ABCs of Functional Behavioral Assessments 


Antecedents: Behavior: Consequences: 
Events that happen before and trigger the An observable act. The resulting event or outcomes that occurs 
behavior. What the student does. immediately following the behavior. 
Reinforcement 
—_ —~ Punishment 
Access - Gain Avoid/Escape — Get 
; Something: out of something: 
Setting Events Triggering Events: Target (Problem) Replacement + Sensory + Sensory 
* — Slow triggers * Fast triggers Behavior Goal: (Appropriate) * — Power/control + Tasks 
Occurrence + Occurrence * Decrease Behavior Goal: * Attention * Socialization 
NOT immediately behavior * Increase Acceptance : Consequences 
i ediately before bel aching behavior and Affiliation + — Stress/anxiety 
immediately before behavior c Nn Gratification ov - achieiinn 
before acquire skills(s) Tangibles * Individuals 
behavior * — Justice/Revenge + Ete 
Ete. 
Hallway expectations and routines clarified and + Students keep voices quiet, keep body to * The Media Specialist observes the students 
taught. : self, and walk on the right side of the following the hallway expectations and says, 
Teachers use prompts/pre-corrects to remind hallway. “Great job of keeping your voices quiet, 


students to walk in the hallway, use quiet 
voices, keep body to self, and walk on the right 
side. 

Teachers greet. while actively supervising the 
hallway. 


keeping your body to the right, and 
staying to theright. You are showing 
respect for others and being safe.” 


SOURCE: Adapted from 2019-2020 Missouri SW-PBS Tier 1 Implementation Guide (Missouri Schoolwide Positive 
Behavior Support, 2019). 
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Potential Obstacles and the Panel’s Advice 


OBSTACLE: Educators may have biases that lead to disproportionality of discipline or 
punishment for a particular group. 


PANEL’S ADVICE: Implicit biases—such as prejudice, stereotype threat, and racial 
anxiety—are attitudes that affect one’s understanding, actions, and decisions in an 
unconscious manner.” As these implicit biases are deep-rooted, a one-time training 
for equity in discipline tends to reduce and possibly eliminate explicit biases but also 
tends to be insufficient to counteract any implicit biases. Promoting specific, ongoing, 
targeted strategies in professional development and learning communities may help 
staff curb implicit biases’ impact on decision-making” by encouraging staff to (a) 
engage in continuous self-reflection either by themselves or with peers, (b) have 
difficult conversions in consultation with a trained and culturally competent 
professional,®*° (c) take deliberate steps to cultivate awareness of their own biases, (d) 
understand the privileges and disadvantages of different groups, and (e) improve their 
understanding of how biases work in education settings. 


Another way to increase awareness of systemic biases in education is to regularly 
review discipline disproportionality data reports.*! However, those data need to be 
supplemented with the development and maintenance of responsive and culturally fit 
practices that consider environmental circumstances and treat students with 
kindness, thereby cultivating positive student-educator relationships. For example, to 
develop a culturally fit practice in their school, the multidisciplinary team can use the 
ReACT intervention” that allows school personnel to (a) identify specific targets for 
intervention, (b) select strategies most likely to address the school needs, and (c) 
implement strategies under a schoolwide approach to fit the school’s culture (e.g., 
team-based implementation, use of existing data systems). An alternate strategy of 
developing culturally fit practices is to use the Double Check framework—which 
includes school-wide data review, professional development, and coaching 
procedures—to reduce disproportionality in discipline.* See 
www.doublecheckcoaching.org for web-based tools and training in the form of 
intervention modules to support both educators and coaches in identifying and 


implementing culturally responsive behavior management practices. 
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OBSTACLE: Teachers who may not use effective classroom behavior management 
strategies, may rely on punishment and exclusion procedures. 


PANEL’S ADVICE: Approaches to classroom management that rely primarily on 
tangible rewards and public or fear-based forms of punishment have been proven 
ineffective in the long run.** Students need to own the social responsibility to develop 
self-discipline and need to have intrinsic motivation to behave appropriately without 
fear of punishment. Establishing behavioral expectations may help students build this 
social commitment. Therefore, in addition to encouraging a school-wide focus on 
behavioral expectations, educators should obtain buy-in from students on both the 
behavioral expectations and consequences for deviating from these expectations. 
However, some teachers may need additional resources and support to develop 
effective classroom behavior management strategies (see resources available online at 
classroom checkup.org*), training in classroom management systems, and 
implementation either through peers using tools such as Classroom Management 
Practices Observation Tool* or through coaching*’ (see Recommendation 3). 


OBSTACLE: Some educators may have philosophical concerns or reservations about 
the use of extrinsic reinforcement and, therefore, may not see this strategy or practice 
as acceptable or feasible. 


PANEL'S ADVICE: Fundamentally changing the behavior of an individual requires 
learning and positive reinforcement to strengthen the desired approach. However, 
educators may be reluctant to use reinforcement or praise, as that typically involves 
changing educators’ own behavior. In addition, educators may have inaccurate 
information about reinforcement being ineffective, have an alternative philosophy 
(e.g., find a common ground with the student), or find reinforcement or praise as 
additional work. The multidisciplinary team should seek to emphasize that educators 
should consider their schools’ actions as building a community with clear norms and 
ways of ensuring student success, which may require all adults to collaborate. Setting 
this collaborative expectation and using data to document student success can be an 
effective way of getting educators to use simple recognition techniques. Another way 
to counteract educator reluctance is through exploring different strategies regarding 
individual educators’ beliefs about their own practices through discussions with 
influential peers or trained coaches. Additionally, data can be used to demonstrate the 
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effectiveness of external reinforcement on establishing and maintaining expected 
behavior and student learning. 


OBSTACLE: Educators may claim that they are not responsible for correcting the 
problem behaviors of students who are not in the educators’ classrooms. 


PANEL’S ADVICE: For reinforcement to change student problem behavior, all school 
staff need to take an approach of active supervision, in which staff positively, 
frequently, and authentically address problem behavior in all settings through 
consistent and fair discipline practices aligned with the school’s system of 
consequences.** Using this school-wide collective approach ensures appropriate 
student behavior and engagement, rather than using an approach in which educators 
take responsibility only for their own students. However, there needs to be a balance 
for responding to problem behaviors immediately and there is a need to avoid 
overwhelming students with corrective actions; therefore, educators should adhere to 
the 4:1 rule of positive to negative feedback. With a heightened educator awareness of 
the 4:1 rule, the message—that any staff member may play a role in unintentionally 
reinforcing student’s problem behavior—can be communicated through professional 
development and coaching to encourage value throughout the school. This 4:1 rule 
reinforcement can establish and build on authentic, positive student-educator 
relationships and, ultimately, establish more effective and more culturally sensitive 
communication while promoting learning. 
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FIGURE 2.10: Effective and Ineffective Approaches to Providing Feedback to 


Students 


EXAMPLES: 


NON-EXAMPLES: 


“Please raise your hand before calling out 
your answer.” 


Shouting “No!” or “How many times do I 
have to tell you to work quietly?” to a 
student. 


“Please use a quieter whisper voice while 
working with your partner.” 

Later: “Thanks for being respectful and 
lowering your voice.” 


A 5-minute conversation about what the 
student was thinking. 

“Don’t you think you should be using your 
time better?” 


“Please keep the lab equipment on the 
table.” 

Later: “Thank you for being safe with the lab 
equipment.” 


“Thank you for being responsible and 
cleaning the area around your table. You are 
helping the cafeteria be a nice place to eat.” 


A teacher loudly tells a student that he is not 
being responsible. 


“What do you think you’re doing?” 
“What’s going to happen if I call your 
mother?” 


“Great job bringing your appropriate 
materials to class today.” 


“Didn’t I just tell you to get your work 
done?” 

“Why are you talking when I’m talking?” 
“Do you want me to send you to the office?” 
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RECOMMENDATION 3: Use Coaching to Support 
Implementation of Evidence-Based Instructional and 
Classroom Management Strategies. 


A myriad of factors can affect the successful implementation of evidence-based 
interventions and practices. These factors include the presence of competency drivers 
(e.g., strategies and methods for selecting staff, training, coaching, and monitoring 
fidelity), organizational and institutional supports (e.g., policies, procedures, data 
systems, and feedback loops), and leadership skills (both technical and adaptive).*° 
Competency drivers are essential for offering support and guidance to school-based 
implementers who may not have the knowledge or skills, or the incentives or time, to 
engage with an evidence-based practice” and for ensuring an intervention or practice 
is implemented as intended.” 


Coaching has emerged as a promising research-based approach” for improving 
implementation of evidence-based instructional and classroom management 
practices.* Coaching is a professional development activity typically conducted on- 
site and focused on application of skills and strategies, frequently taught or developed 
initially through didactic workshops, within authentic practice settings (e.g., 
classrooms). Whereas initial training is a professional development activity associated 
with establishing new skills and knowledge, coaching is the professional activity 
associated with facilitating use of established skills and strategies within local 
settings/situations. Similar to school-based consultation, best practices in coaching 
involve using a systematic data-driven problem-solving process focused on prevention 
and remediation, in which observation and performance feedback can be powerful 
for achieving growth in educator’s skill and strategy use. 


The panel believes coaching to be an important, effective implementation activity™ 
that can be used to supplement initial training and provide ongoing professional 
development to educators, particularly those who are new to the profession.* 
Although training is critical for building knowledge of any practice, training supported 
by ongoing coaching can result in individual educators implementing 80-90 percent 
of new practices.** As a result, coaching not only has the potential to help educators 
build capacity, develop skills, and increase confidence to implement practices with 
high fidelity, but coaching can also maximize the transfer and translation of skills 
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acquired during training into sustainable practice.® To support implementation of 
recommended practices, the panel considers coaching to be an overt, durable, and 
necessary link between an educator’s training and actual use of practices. 


The panel suggests that coaching be provided in gradual approximations, starting with 
universal coaching provided to all educators and ending with intensive, individualized 
coaching for a few educators. For example, as school multidisciplinary teams establish 
major components of their school-wide implementation plan, all educators may need 
frequent, in-person, and direct coaching support. As school staff achieve 
implementation fluency, coaching activities can be less frequent and more informal, 
with only a few educators receiving individualized coaching to address challenges in 
implementation. With more advanced implementation teams, coaching could focus 
on helping school multidisciplinary teams assess the accuracy and consistency of their 
implementation plans, maximize targeted outcomes, increase implementation 
efficiency, acknowledge and communicate progress to district and state leadership, 
and facilitate data review to enhance school-wide implementation plans.°? 


Several coaching models and efforts focus on individual educators. These models and 
efforts provide organization and structure that can motivate individual educators to 
adopt new practices and to support evidence-based instructional and classroom 
management practices. Furthermore, some of the latest coaching model adaptations 
have been shown to improve educators’ delivery of social emotional curricula,’ 
increase teacher response to bullying behavior,'! increase adoption of culturally 
responsive practices,'” increase use of classroom management practices,'°? and 
reduce disproportionality in discipline.'°* Importantly, the procedures and interactive 
styles in such coaching models are based on motivational interviewing, a collaborative 
conversational style for strengthening a person’s own motivation and commitment to 
change.'°> Multicomponent consultation frameworks that integrate motivational 
interviewing techniques as well as strategies targeting educator knowledge, skills, and 
attitudes hold promise for improving educators’ implementation of general classroom 
Management strategies and targeted intervention supports.! 


Coaching can likely be integrated into the job responsibilities of multiple professionals 
within a school or district. For example, school psychologists often play specialized 
roles in supporting students’ academic and behavioral needs: a school psychologist or 
school social worker may serve as an individual coach in the school, as long as they 
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have the necessary skills to build positive and supportive relationships with staff and 
encourage adult behavioral change. Similarly, districts can incorporate coaching 
responsibilities into the roles of team leaders and department chairs, provided they 
have the appropriate training and are given adequate support. Achieving all of these 
coaching expectations can be difficult in the context of shrinking resources, multiple 
competing and overlapping initiatives, lack of available qualified personnel, and time. 
Although the majority of coaching efforts occur at the classroom level, the panel 
recommends developing the infrastructure to support coaches at the district level. 
Specifically, districts should identify a single coaching model and provide 
coordinators who can oversee training and monitoring of implementation fidelity, 
including coaching-specific processes and skills (See Recommendation 5 for 
additional discussion on the importance of district- and state-level coaching). 


Educators, administrators, related service providers, and school-based mental health 
practitioners who engage in coaching should be taught specific skills to change adult 
behavior and to apply those skills in the context of the coaching process. People who 
carry out coaching responsibilities require ongoing support and feedback, which 
reinforces the continuous use of their coaching skills and allows these individuals to 
implement coaching with confidence. Moreover, coaching to influence a team’s 
collective behavior can increase organizational support to implement practices with 
fidelity; this type of collective coaching requires additional skills, such as consensus 
building. The panel recommends that school multidisciplinary teams ensure that 
individuals who provide coaching have the necessary experience with individual or 
school team implementation and problem-solving and that the individual’s own 
coaching preparation is linked with actual individual or school team training. 


Recommendation 3 was informed by three studies of interventions with coaching 
components. Two of the studies meet WWC group design standards without 
reservations,'°° and the other study meets WWC group design standards with 
reservations.’°? In all three of the studies used to support Recommendation 3, 
coaching to support implementation of evidence-based instructional and 
classroom management strategies was a major component of the tested 
intervention. 


The panel has confidence in the research suggesting that using coaching to 
support implementation of evidence-based instructional and classroom 
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management strategies is an effective practice. See Appendix C for detailed 
descriptions of the intervention features and findings from each study informing 
this recommendation. 


How to Carry Out the Recommendation 


This section describes strategies, examples, and tools available for coaches to support 
implementation of evidence-based instructional and classroom management 
strategies. All figures and mentions of specific coaching strategies in Recommendation 
3 are offered as examples only and should not be read as endorsements of specific 
products or approaches. 


The guidance below is informed by the studies that support the recommendation, as 
well as the expert panel’s expertise and knowledge of resources and strategies 
available to help implement the recommendation. 


FIGURE 3.1: Steps to Implement Recommendation 3 


Identify the Functions and Purpose of Coaching. 


Develop an Infrastructure to Support Coaching (Time, Space, 
Personnel). 


Identify a Coaching Model/Process Necessary to Implement Practices 
Effectively. 

Provide Professional Development in the Coaching Model and Skills. 
To Guide Revision of Coaching Efforts, Obtain Data About 


e The Perceived Value of Coaching and 
e Whether Coached Skills are Being Performed. 
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1. Identify the functions and purpose of coaching. 


Implementing any new practice with fidelity and sustaining implementation over time 
may require effective coaching to support educators’ learning as they translate 
implementation plans into actionable steps."° Three main contexts for coaching are 
necessary in schools: systems coaching, coaching teams or groups, and individual 
coaching" (see Figure 3.2). 


e System coaching focuses on building organizational support (policies, 
practices, and resources) by creating consistent and sustainable systems, so 
school staff can implement practices with fidelity. Coaches can help district and 
school administrators understand the intervention’s core components and the 
systems, features, and infrastructure needed for successful, sustained 
implementation. Coaches can guide district personnel to ensure necessary 
professional development at the team and individual levels and to ensure 
organizational changes that support implementation of new practices. This 
level of coaching requires fluency with implementation science" and 
frameworks. (See Recommendation 5 for more guidance on implementation 
science and frameworks.) 

e Coaching teams or groups helps teams develop their collaboration and 
facilitation skills, establish team operating procedures, understand group 
dynamics as the team applies new skills in context, and solidify data-driven 
decision-making processes. While implementing evidence-based practices, 
coaches can guide teams on how to make the new practice fit their schools’ and 
classrooms’ communities, contexts, and cultural settings. 

e Individual coaching focuses on skills acquisition and application in context 
after initial training activities. Coaches provide support and give performance 
feedback to educators to ensure use, fluency, confidence, and acceptable 
implementation and adoption of trained skills. 


When planning for systems to support implementation, state, district, and school 
leaders may benefit from identifying adequate coaching capacity to support systems, 
teams/groups, and individual change. Each type of coaching serves a different 
purpose, and all three combine to help ensure that evidence-based practices can be 
implemented and sustained to improve student outcomes. To build coaching capacity, 
district and school leadership teams must understand and measure school staff 
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readiness and must tailor support based on readiness across all professional 
development activities. The Coaching Inventory Discussion Tool may help district and 
school leadership teams understand the current coaching infrastructure, identify 
which coaching functions currently exist, and identify where the gaps exist so that the 
team can develop a coaching service delivery plan. A coaching service delivery plan is 
a proactive approach to purposeful and supportive coaching and describes both the 
coach’s and the practitioner’s responsibilities, specifying the coaching elements that 
will promote quality service delivery through support for the system, team/group, or 
individual educator. The coaching service delivery plan serves as the basis for further 
professional development." 


FIGURE 3.2: Coaching Contexts 


Regional/State 


Leadership 
Team 


_ SCHOOL STAFF i STUDENT BENEFIT} 


+ 3- to 5-year action plan 

+ Tier 1 (School-wide) 

* Tier 2 (Small group) 

+ Tier 3 (Individual 
student) 

+ Data systems 


4)DISTRICT TEAM El\SCHOOL TEAM 


+ 3- to 5-year action plan 

+ Practices, data, systems 

+ Policy, funding, 
visibility, political 
support 

+ Readiness, priority, 

commitment 


+ 3- to 5-year action plan 

+ Data plan 

+ Leadership 

+ Training, coaching, 
content expertise, and 

evaluation 


+ 3-to 5-year action plan 
+ Data plan 

+ Leadership 

* Training, coaching, 
content expertise, and 
evaluation 


SOURCE: Adapted from PBIS District Level Coaching Brief. 


2. Develop an infrastructure to support coaching (e.g., time, space, personnel). 


It is critical for districts to have an infrastructure that provides research-based, 
consistent, ongoing, convenient, sustainable, relevant, and differentiated coaching to 
all educators in the district or school.''* This infrastructure should include schedules 
that protect time for coaching, funding to support coaching activities (e.g., if 


Promoting Social and Behavioral Success for Learning in Elementary Schools 54 


substitute teachers are needed to release teachers from classrooms) and clear 
delineation of which professionals are involved in the coaching process. This includes 
those with coaching in job responsibility, as well as educators in need of coaching 
with a clear method for identifying who will benefit from overall vs. individualized 
support (see Figure 3.3 for help identifying the need for coaching).'' 


Providing quality coaching to staff will help ensure that interventions or practices are 
implemented with fidelity and sustained. The development of a coaching system to be 
applied throughout the school year is key to the success of training and ongoing 
support. The coaching process should first ensure that trust is established between 
coaches and educators. The panel recommends that a coaching service delivery plan— 
a written plan establishing the coaching process—should specifically outline the 
coaching supports provided to staff who carry out the program or practice. The 
coaching service delivery plan should outline (1) requirements for coaches to be 
experts in delivering the program or practice, (2) required frequency of coaching, and 
(3) coaching methods. In addition, the multidisciplinary team should conduct 
frequent review of a coach’s adherence to the coaching plan at least three times a 
year.!!° As the multidisciplinary team uses data-driven decision-making and connects 
the action plan to the school and district mission, it is critical to engage all educators 
in planning and implementation, which ensures implementation fidelity and 
improved student academic/behavioral success.''’ 


FIGURE 3.3: Help Identify the Need for Coaching 


Answering the following questions will help you 


DISCUSSION develop your systematic, multitiered plan for 
supporting all teachers: 
} D ¢ What kinds of school-wide supports do your staff 
e@ @ need? How do you know? 
ai a> * What tools/checklists do you currently have for 


classroom observation? 

What resources do you have to provide didactic 
(direct, systematic) training? 

How will you structure a system for self-monitoring 
and data-reporting? 

Who can be tapped to be coaches in your building? 
How will you train them for their role? 


SOURCE: Adapted from Simonsen et al. (2014). 
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Before providing coaching-specific professional development, multidisciplinary teams 
should provide professional development activities involving explicit, organized initial 
training on implementing the evidence-based practices that coaching efforts are 
designed to influence. Following initial training, the district and school teams are 
encouraged to assess staff’s current skills, experience, and existing practices, to help 
coaches ascertain the adult behaviors (e.g., instructional and classroom management 
practices) they need to influence. 


Who needs coaching? Technology can be used to provide universally supportive 
coaching to all educators, while more expensive in-person consultations can be 
offered to those educators who are new or require additional support to implement 
effective instructional or classroom management strategies aligned with the school’s 
needs.''* For example, a three-tiered coaching support framework could be used for 
providing supports and a clear method for identifying which educators will benefit 
from each level of support.!!? This multi-tier system is informed by data and educators 
receive coaching based on data. All educators could receive universal coaching 
support (Tier 1) focused primarily on high-quality, indirect coaching; some educators 
could receive universal coaching plus limited coaching supports (Tier 2); and a few 
educators could receive all of the above plus intensive coaching supports (Tier 3). This 
model, the “triangle for teachers,” could be a feasible way for schools to provide 
coaching to educators and staff (see Figure 3.4). 
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FIGURE 3.4: A Multi-Tier Coaching Model 


Tier 3 
Intensive Coaching: 
Data-Driven 
Consultation 


Progress Monitoring 
Walk Through, Data 
Screen, and Teacher 

Collected Data 
Tier 2 

Targeted Coaching: 

Self-Management 


Universal 
Screening 
Walk Through and 

Data Screen 


Tier 1 
Universal Coaching: 
Training and Self- 
Monitoring 


SOURCE: Adapted from Simonsen et al. (2014). 


Who provides coaching? Coaching can often be integrated into the job 
responsibilities of multiple professionals within a school or district, such as educators, 
administrators, related service providers, and school-based mental health 
practitioners. Although the majority of coaching efforts occur at the classroom level, 
the panel recommends developing infrastructure to support coaches at the district 
level. Specifically, districts should identify a single coaching service delivery plan and 
provide coordinators who can oversee training and monitoring of implementation 
fidelity, including procedures and coaching-specific skills (Gee Recommendation 5 
for additional discussion on the importance of district- and state-level coaching).'”° 
See Figure 3.5 for a list of questions that can help districts or schools develop a 
coaching service delivery plan. 
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FIGURE 3.5: Questions to Ask While Planning to Develop Coaching Service 
Delivery Plans 


As your team engages in planning of the coaching service delivery methods and 
processes, consider the following: 


e What are the concepts, skills, or areas to be coached? 

e What coaching process or processes (e.g., direct observation, documentation review) will be 
used? 

e How often will the coaching processed be used? How will the frequency be adjusted as 
practitioners or instructional staff gain experience and grow in their skill competency? 

e What preparation is needed for the coaching process? For example, what data or 
documentation is to be collected or reviewed and is there a timeline for clear submission to 
the coach? 

e What is the format of the post-meeting/post-event following the coaching process? For 
example, will the coach provide feedback during a face-to-face meeting with the practitioner 
or instructional staff or during a group reflection meeting? 

e How will the coach document the feedback provided? Will feedback be verbal, written, or 
both? 

e  Isthere a timeline for when the coach should provide the written documentation? For 
example, written documentation is to be provided within 72 hours after verbal feedback, 
quarterly, etc. 

e How will we know coaching is effective? What data will be collected, and how will it be 
collected and analyzed for continuous improvement purposes? 

e What is our plan for monitoring adherence to the coaching service delivery plan? By whom, 
how, how often, and when will the plan be reviewed? 


SOURCE: Adapted from the National Implementation Research Network (NIRN, 2009). 
3. Identify a coaching model/process necessary to implement practices effectively. 


Educators, administrators, related service providers, and school-based mental health 
practitioners who engage in coaching should be taught specific skills to change adult 
behavior and to apply those skills in the context of the coaching process. However, the 
skills required to successfully influence adult behavior are distinct from the skills 
required to implement the instructional and classroom management strategies that 
coaching is designed to support. To date, little is known about what baseline skills or 
training make some coaches more effective than others. At a minimum, the panel 
believes an effective coach is skilled at developing and maintaining positive 
relationships with colleagues. 
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Individuals who coach need a process, as well as special skills, to motivate educators 
to change existing behavior. Learning to coach effectively takes time and effort, and 
not everyone is suited to coaching. Coaching skills should be developed using 
common approaches to imparting knowledge, '”! including the provision of training 
and ongoing support to dedicated coaches!” and the development of infrastructure to 
support coaching at the district level. Along with a consistent coaching process, the 
panel recommends creating a training infrastructure that not only supports 
individuals who coach to follow the recommended process but also provides them 
with the skills needed to successfully navigate the coaching process with educators. 
Below, we recommend a few useful coaching models districts might consider. 


The GROW coaching model, represented in Figure 3.6, provides a simple but proven 
framework to develop a coaching service delivery plan that is meaningful, relevant, 
and impactful.!° 


FIGURE 3.6: The GROW Coaching Model by John Whitmore and Graham 
Alexander 


The Key to GROW 
The key to using GROW successfully is first to spend sufficient time exploring "G" until the 
coachee sets a goal that is both inspirational and challenging for them. Then, you must 
move flexibly through the sequence, using your intuition, including revisiting the goal if 
needed. 


Which options are 

working smarter not 

harder? 

How will you/we 

know you've been 
2 


* How have you tackled 
similar situations 
before? 

* What has contributed to * If anything is possible, 
your success so far? what would you do? 

* How do you think kids 
feel? Parents feel? 

* Does this goal conflict 
with any other goals? 


SUuCC 


What do you want to 
achieve? 


What areas do you 
van ork on? 


SOURCE: Adapted from 2019-2020 Missouri SW-PBS Tier 1 Implementation Guide (Missouri Schoolwide Positive 
Behavior Support, 2019). 
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A second coaching model is organized by function. In this framework, after initial 
teaching of practices to educators, coaching involves building a working alliance, 
prompting, performance feedback, building fluency, and modification/adaptation (see 
Figure 3.7).'*4 


FIGURE 3.7: Five Steps for a Coaching Framework 


ae Building Fluency — Coaching sometimes involves creating more » , 
opportunities to practice a skill so that the educator becomes more fluent cea 
comfortable with using the skill. For example, the use of corrective 
consequences is a skill that educators often need to practice, so they can build 
fluency and avoid implicit bias. 


5. Modification/Adaptation — Coaching often involves helping educators 
adjust/adapt/modify a newly trained skill to fit the cultural or organizational 
expectations of their environment. 


SOURCE: Adapted from Massar (2018). 


Another coaching model is promoted by the Classroom Check-up.'”° As seen in Figure 
3.8, the Classroom Check-Up involves an initial teacher interview and classroom 
assessment, followed by a multi-step performance feedback loop. Another useful 
model is the Motivational Interviewing Navigation Guide!” (see Figure 3.9). The 
navigation guide provides a 5-step coaching process that includes a values discovery 
interview, assessment of current practices (which can be any evidence-based 
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instructional or classroom management practice or strategy), a performance feedback 


meeting, extended support, and closure. The references to preparatory change talk, 


mobilizing change talk, and evocation in Figure 3.11 are described in the next section. 


Both the Classroom Check-Up and Motivational Interviewing Navigation Guide are 
informed by motivational interviewing concepts.'’ The skills associated with this 
practice are also described in the next section. 


FIGURE 3.8: Classroom Check-Up Coaching Process 


ASS@sS 
(OE wereyin 


y Evafuate : ‘Check-Up 
| Intervention | Meeting 


; ; 1Xaaelorte 
’ Implement \ 
| Integvention | 


Choose Med of 
Intervention | Op s 


Performance Feedback Loop 


SOURCE: Adapted from the Coaching Process on Classroom Check-Up Website. 
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FIGURE 3.9: The Motivational Interviewing Navigation Guide 


Step 1. Engage in values discovery 
* Working alliance 

* Ecological assessment 

* Values discovery activity 


Step 2. Assess current practices 

* Current practices interview 

* Collect fidelity data of critical implementation 
features 


Step 3. Share performance feedback 
* Conduct debriefing interview 


Step 4. Offer extended consolation, 
education and support (optional) 


Step 5. Provide closure 


SOURCE: Adapted from Frey et al. (2013b); Lee et al. (2014) and Frey et al. (2020). 


Another useful practice-based coaching framework (see Snyder et al., 2022) is used in 
BEST in CLASS.!?8 BEST in CLASS-Elementary is an intervention that consists of 
workshops, teaching manuals, and practice-based coaching to help educators learn 
effective practices to enhance home-to-school partnerships and support positive 
behavioral and academic outcomes for students with challenging classroom behavior. 


4. Provide professional development in the coaching model and skills. 


It is critically important that professional coaches train educators to deliver content 
by teaching and modeling best practices that lead to educators developing fluency 
with delivering the essential components of the evidence-based practice. Because 
educators must learn when, how, and with whom to use new skills and practices, the 
expert panel recommends that the initial training be organized into short teaching 
modules, with clearly defined activities and outcomes designed to lead to actionable 
steps for individual implementation. Also, the panel recommends following the basic 
steps listed in Figure 3.10. 
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This initial training should 


e provide information related to the theory and underlying values of the practice, 

e use training processes grounded in adult learning theory to actively engage 
participants, 

e introduce the components of and rationales for key practices, and 

e provide opportunities to practice new skills and receive feedback in a safe and 
supportive training environment. 


FIGURE 3.10: Basic Steps to Help Organize Initial Training 


4, Schedule opportunity for school team to a ply 
information through structured activities. 


3 


5. Develop action plan steps. 


SOURCE: Adapted from Lewis et al. (2016). 


Individuals who coach can also encourage new educators to implement behavioral 
practices by training the new educators before the school year starts. Coaching 
individuals can also provide ongoing support throughout the school year, until 
staff/educators demonstrate mastery of the new skill. 


Research is just starting to identify the specific skills that individuals need to have for 
their coaching to be effective as a professional development strategy. There is a 
substantial need for coaching models that clearly and comprehensively specify (a) the 
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conversational skills individuals must have for their coaching to successfully influence 
teacher implementation of effective practices; (b) the scope and sequence of 
professional development systems capable of equipping individuals with these 
conversational skills; and (c) skill-based proficiency standards. '”’ 


As noted earlier, the Classroom Check-Up and the Motivational Interviewing 
Navigation Guide are informed by motivational interviewing. Motivational 
interviewing-based models are distinct from other coaching models because the skills 
associated with this practice are well defined, and extensive literature informs the 
procedures required to teach people to use these skills proficiently. Furthermore, a 
comprehensive theory associated with motivational interviewing describes the 
mechanisms of change within the coaching process.'*° 


Three core ingredients, described in Figure 3.11, make motivational interviewing 
effective:'*! the technical component, the relational component, and (the absence of) 
motivational interviewing-inconsistent behaviors (confrontation and persuasion). 
These three active ingredients, combined in the context of overlapping and recursive 
processes that include engaging, focusing, evoking, and planning, define motivational 
interviewing fidelity (see Figure 3.11). These three ingredients should be central to 
any definition of motivational interviewing quality. 
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FIGURE 3.11: Ingredients of Motivational Interviewing 


The technical component refers to the practitioner’s ability to 

shape the conversation, so the practitioner is evoking participant 

change talk (i.e., language that supports a shift from the status quo) 

of greater depth, strength, and frequency, while acknowledging 
esa | but not reinforcing sustain talk, or language that supports the 


status quo. The practitioner performs conversational shaping by 
intentionally and strategically utilizing core motivational 
interviewing skills, which are represented by the acronym OARS 


(i.e., open-ended questions, affirmations, reflections, and 
summaries) to strengthen the participant’s motivation for change. 


The relational component consists of accurate empathy, respect 
for participant autonomy, and egalitarian collaboration. The 
relational component is the way practitioners use the OARS skills, 
often referred to as the motivational interviewing spirit. 


¢3 Motivational interviewing-inconsistent behavior refers to the 
a2 use of confrontation (e.g., lecturing, shaming, coaxing, arguing) 
and persuasion (e.g., being overly directive with the participant or 
offering unsolicited advice or advice without permission). 


SOURCE: Adapted from Miller & Moyers (2017); Miller & Rollnick (2012); Magill et al. (2014) and Miller & Rose 
(2009). 


Research on learning motivational interviewing reveals that skillful use requires 
expert-led workshops followed by objective evaluation and reflection.'? Self-study or 
workshop-only training efforts are not sufficient to change educator behavior because 
they only lead to perceptual or attitudinal changes and some initial skill development 
instead of fluency,'* irrespective of the setting where the training participants are 
being prepared to practice motivational interviewing.'** Learning opportunities must 
include skills related to both the relational and the technical components of 
motivational interviewing, as well as strategies to help practitioners avoid inconsistent 
practices in motivational interviewing.'*> 
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The Motivational Interviewing Network of Trainers (MINT) is a method to create 
a pool of qualified instructors using a Train the Trainers model. Accessing the MINT 
website to find a qualified trainer is a useful starting point for school staff interested in 
being trained through a motivational interviewing expert or Train the Trainer 
approach. The panel believes that it is far more useful to be trained by someone who 
has school-based experience and who is able to contextualize motivational 
interviewing in interactions relevant to school-based personnel. 


The Motivational Interviewing Training and Assessment System (MITAS) is a 
comprehensive professional development system that closely matches training 
procedures used to train skilled practitioners in the field of substance and alcohol 
misuse; this system has been adapted to coach educators in school-based 
application.!*° As depicted in Figure 3.12, the MITAS consists of multiple 
workshops, '*’ a simulated practice routine, authentic practice, and a learning 
community. Workshop delivery modules can be flexible (in person or virtual), 
depending on participant needs, and can be contextualized to represent school 
situations. The MITAS is a useful resource for skilled motivational interviewing 
practitioners who want to train other school-based personnel.!** Districts or schools 
seeking more information may wish to review Frey et al. (2017), which summarizes 
the guiding principles and objectives of motivational interviewing workshops. 
Furthermore, many of the materials needed to use the MITAS training can be found 


on the Responsible Use of Motivational Interviewing in Schools website, including 
materials to support motivational interviewing skills for coaches. 
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FIGURE 3.12: The MITAS Model 
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SOURCE: Adapted from Frey et al. (2017). 


The Classroom Check-Up website also provides useful resources for developing 
individuals’ coaching knowledge and skills, so they can support educators in effective 
classroom management. 


Additionally, coaching should follow the same steps suggested when students are 
taught (see Figure 3.13, which follows steps similar to Figure 1.1). 


FIGURE 3.13: Basic Teaching Model for Coaching 
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Finally, the following resources are available to support coaching personnel: (1) PBIS 
resources for coaches and (2) the PBIS Cultural Responsiveness Field Guide: 


Resources for Trainers and Coaches. The latter resource is for coaching personal who 


are working with school teams to implement culturally responsive practices that 
systemically enhance equity in school discipline. !*° 
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5. To guide revision of coaching efforts, obtain data about (a) the perceived value of 
coaching, (b) the fidelity of the coaching, and (c) the extent to which the coached skills 
are being performed. 


A robust coaching system relies on multiple data sources to assess the effectiveness of 
coaching activities, including direct observations, implementation fidelity measures, 
and practitioner satisfaction surveys.'*° Ongoing evaluation of coaching efforts using 
quarterly performance assessments should combine the aforementioned data sources 
to assess coaching effectiveness related to practitioner implementation fidelity, 
coaching fidelity, and the perceived value of coaching. Direct classroom 
observations'*' in combination with implementation fidelity measures (as discussed in 
detail in Recommendations 1 and 4) can be used to assess whether an educator is 
practicing their newly developed skills through coaching with fidelity. Similarly, 
coaching fidelity data can be collected through self-reports or direct observations of 
coaching activities. Examples of self-report data can include a checklist of coaching 
components, such as modeling and/or prompting, observational data collection, 
videotaping the educators’ implementation of practices during the selected activity, 
and completing anecdotal notes. Furthermore, trained observers can collect 
observational data on coaching activities using coaching fidelity forms such as the 
BEST in CLASS Coaching Integrity form (see Figure 3.14). For motivational 
interviewing-informed coaching models, the panel recommends the Motivational 
Interviewing Treatment Integrity (MITI) tool,'*? which enables examination of 
motivational interviewing fidelity through coding of 4 global scores, 10 behavior 
counts, and 5 summary scores. Finally, surveys can capture critical data on the 
perceived value of coaching by measuring the extent to which the coaching 
intervention was perceived as socially valid to the participating educators. '*? 


Using evidence-based instructional and classroom management strategies provides an 
additional advantage because these strategies have measures that define whether the 
intervention is being implemented with fidelity. Although these fidelity measures 
historically have been used in research settings, they can be modified for use within 
practice settings. !“4 


Data on the perceived value of coaching and coaching effectiveness should inform 
subsequent efforts to revise coaching efforts. These data can drive revisions and 
updates to the coaching service delivery plan to inform school-wide coaching efforts, 
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or to provide individualized coaching support to educators who are implementing 
effective teaching strategies. As discussed in Recommendations 4 and 5, 
multidisciplinary, representative leadership teams in schools, districts, and states are 
encouraged to include in their comprehensive action plans strategies for organizing, 
analyzing, and making data-based decisions on coaching activities relative to their 
impact on educator implementation and student outcomes. 


A Staff Handbook, as illustrated in Figure 3.15, could include clear definitions of the 
process from initial and ongoing training, self-monitoring and -assessment, 
performance feedback, retooling and technical assistance, and planned 
improvements. This handbook can act as a reference that organizes and documents 
school-wide data, systems, and practices and can serve as an accessible resource. 


FIGURE 3.14: BEST in CLASS Coaching Integrity Observation Report 
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SOURCE: Adapted from Sutherland et al. (2015). 
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FIGURE 3.15: Details to Include in Handbook for the Coaching Service Delivery 
Plan 


Develop a year-long coaching schedule within the workday for all teachers and staff 
outlines: 


a. Time and place 
b. Schedule of topics (suggestions include): 
i. Accessing resources necessary for tiered supports 
ii. Self monitoring implementation 
iii. | Implementing essential skills of coaching and model for coaching 
iv. Implementing essential components of tiered supports (e.g., teaching, reinforcing, 
discouraging, data collection, student self-monitoring) 
v. Implementing effective classroom practices (e.g. reinforcing, active supervision) 
c. Identify expertise to provide coaching 
d. Identify expertise or experts for coaching 
Implement your year-long coaching schedule and consistently communicate aggregated school-wide 
data to demonstrate growth in proficiency in implementing effective practices and improved student 
outcomes. 


SOURCE: Adapted from 2019-2020 Missouri SW-PBS Tier 1 Implementation Guide (Missouri Schoolwide Positive 
Behavior Support, 2019). 


Potential Obstacles and the Panel’s Advice 


OBSTACLE: There is not enough time and infrastructure to build the capacity to 
support coaching. 


PANEL'S ADVICE: Although it would be ideal to coach all school staff all the time, 
providing coaching at this effort level is rarely feasible or sustainable due to time, cost, 
and logistical concerns. To initiate those early discussions about the importance of 
coaching and the facilitative supports and systems, administrators need to consider 
the NIRN Coaching System Development worksheet, which may be a useful tool for 
ensuring a systemic commitment to coaching. The panel recommends that schools 
should 


e actively develop and implement coaching service delivery plans that detail how 
often, where, when, with whom, and why coaching will occur; 

e use multiple data sources to provide feedback to practitioners, including 
assessments that start with interviews and involve direct classroom 
observations; 
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e leverage engagement techniques, like motivational interviewing, to foster 
educator buy-in for the change process; 

e use data-driven decision-making from coaches to inform training 
improvements and improve organizational supports; and 

e establish professional learning communities where district coaches can meet 
regularly (e.g., monthly) to solve problems and develop their own coaching 
skills. 


Increasingly, district- and state-wide initiatives are being used to support the 
dissemination of training and coaching systems. Readers can refer to 
Recommendation 5 for information on how districts and states can invest in 
coaching and other implementation drivers to ensure that educators, staff, and 
administrators have the capabilities to implement practices as intended. 


OBSTACLE: Most educators, administrators, related service providers, and school- 
based mental health practitioners are not prepared to coach or do not have the right 
skillset to coach, so districts need to have a formal, centralized onboarding process to 
build capacity for effective coaching. 


PANEL’S ADVICE: Individuals who coach need special skills to motivate educators to 
change existing behavior. Learning to coach effectively takes time and effort, and not 
everyone is suited to coaching. These skills should be developed using common 
approaches to imparting knowledge,'*’ including providing training and ongoing 
support to the dedicated coaches'** and developing the infrastructure to support 
coaching at the district level. See Figure 3.6 for the GROW coaching model, which 
provides a simple but established framework to develop a coaching method that is 
meaningful, relevant, and impactful.'*? For example, a psychologist or a former 
educator at the school can be trained using the GROW coaching model. 


Schools seeking more information may wish to access resources that explore some 
best practices for coaches. Recent emerging evidence reveals that coach-educator 
alliances are crucial to improved implementation.’ As a result, training for coaches 
should include tools and resources to build trust and relationships with educators and 
staff, as well as to engage educators who might be initially resistant to change. The 


Classroom Check-Up website and First Step Classroom Check-Up Resource Manual 
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provide additional useful resources for individuals to develop their coaching 
knowledge and skills to support educators in effective classroom management. 


OBSTACLE: Dedicated expert coaches for all educators in the school can be 
expensive, especially for schools and districts lacking resources. 


PANEL’S ADVICE: School-based coaching is a promising approach to professional 
development for educators; however, this kind of in-person, dedicated coaching for 
all educators may not be feasible for schools and districts that lack resources. The 
panel suggests starting with professional development for all educators and 
considering differential supports for a few based on each educator’s implementation 
and needs (see Figure 3.4). Educators can then receive coaching in gradual 
approximations through step-by-step consultation, ending with an individual 
consultation.'*! Schools lacking in resources could reallocate existing resources to 
build a robust infrastructure that prioritizes coaching. For example, schools can 
repurpose roles and responsibilities of existing staff to train a school-based coach. 
Another approach would be to train a small multidisciplinary team to learn the key 
practices for improvement, and these team members can then function as coaches 
and use staff meetings to inform groups of the activities conducted, as well as provide 
support and encouragement as needed. The panel recommends that, while school 
multidisciplinary teams participate in the training and after they master the basic 
material, teams should meet approximately once per month to review training 
content and set up a regular process of reviewing and refining goals (initial goals are 
developed during training) and other site-based activities. A clear and consistent 
format and operating procedure for these meetings needs to be specified (see Team- 
Initiated Problem Solving for details'*’). 
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RECOMMENDATION 4: Collect, Summarize, and Use 
Fidelity and Student Outcome Data at All Levels for 
Iterative Decision-Making and Problem-Solving by 
Stakeholders. 


Compared to schools that do not include data in decision-making processes, schools 
and districts that utilize data to make decisions are more effective and efficient in 
addressing student challenges.'* The collection and analysis of fidelity and outcome 
data allows schools and districts to diagnose problems, determine which practices are 
most effective, determine whether selected practices are being implemented with 
fidelity and, ultimately, assess how and if practices are improving student outcomes. 
As such, schools and districts should collect and use fidelity data to assess and 
monitor whether practices are being implemented as intended. Student outcome 
data, including office discipline referrals, suspensions, and school climate, can be 
used to assess whether practices are meeting student needs. 


Recommendations 1 and 2 highlight the importance of establishing 
multidisciplinary representative teams to lead the implementation of prosocial 
practices within elementary schools, along with the importance of developing systems 
for monitoring and adjusting behavioral expectations. Multidisciplinary representative 
teams use data to monitor and adjust behavioral expectations and present outcome 
and fidelity data to stakeholders to provide leadership on developing, implementing, 
and sustaining prosocial practices. This recommendation discusses how 
multidisciplinary problem-solving teams—consisting of members who have the 
requisite experience and expertise in working with data and training in structured 
decision-making processes—can support multidisciplinary representative teams by 
utilizing fidelity and outcome data to engage in iterative decision-making and 
problem-solving. 


A problem-solving team and outcome- and fidelity-focused data systems are 
foundational elements for incorporating data into decision-making processes. 
Problem-solving teams are responsible for analyzing data to identify behavior 
problems, developing solutions, monitoring implementation fidelity, and examining 
the effectiveness of practices for improving student outcomes. A key benefit of teams 
is their ability to incorporate multiple perspectives, including those of administrators, 
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specialists, and educators, in order to identify comprehensive solutions. To fulfill this 
critical role, it is important that problem-solving teams have the responsibility and 
authority to use data and follow protocols that provide a structured approach for 
decision-making based on given data. Whenever possible, teams should be trained on 
structured decision-making processes; research demonstrates that trained teams show 
higher levels of problem-solving and, critically, that improved problem-solving has a 
positive impact on student outcomes." 


To support the efforts of problem-solving teams, outcome and fidelity data systems 
must provide the necessary data, in the proper format, at the right time. Problem- 
solving teams, in consultation with the multidisciplinary representative teams and 
school and district leaders, can evaluate electronic data management systems with the 
capacity for data entry, reporting, and analysis that best meets their need to use data 
efficiently and effectively to answer questions posed by the problem-solving team and 
other stakeholders. Once the data systems are in place, problem-solving teams can 
use their decision-making protocols to collect, analyze, and utilize data in a routine, 
formal, and direct manner. Key questions for problem-solving teams to consider 
include the following:'° 


a. What topic or problem needs to be addressed? When, where, and how should 
that topic or problem be addressed? 

b. What intervention or practice might best address the topic or problem? 

c. How well have administrators, educators, and support staff been prepared to 
implement the intervention or practice? 

d. How well is the intervention or practice being implemented (i.e., fidelity)? 

e. How well are students responding (i.e., progress monitoring)? 

f. What adjustments are needed to improve implementation fidelity and student 
responsiveness? 


Utilizing data to guide decision-making and problem-solving approaches may involve a 
significant shift in policies and procedures for some schools and districts. As such, 
problem-solving teams, alongside the multidisciplinary teams, can remind 
stakeholders that the significant time, training, and resources invested in 
implementing prosocial practices may necessitate a longer passage of time before the 
implementation of these practices results in positive, permanent change that 
improves student outcomes and promotes a positive school-wide social culture. 
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Throughout the early stages of the implementation process, problem-solving and 
multidisciplinary representative teams and school or district leadership may want to 
regularly emphasize the positives of data collection while also using data to 
demonstrate progress and celebrate successes. 


Recommendation 4 was informed by five studies of the effectiveness of using fidelity 
and student outcome data to engage in iterative decision-making and problem-solving. 
Three of the studies meet WWC group design standards without reservations,* while 
the other two studies WWC group design standards with reservations." In all five of 
the studies used to support Recommendation 4, collecting, summarizing, and using 
fidelity and outcome data to engage in iterative decision-making and problem-solving 
was a major component of the tested intervention. 


The panel has confidence in the research suggesting that collecting, summarizing, 
and using fidelity and outcome data is an effective practice. See Appendix C for 
detailed descriptions of the intervention features and findings from each study 
informing this recommendation. 


How to Carry Out the Recommendation 


This section describes strategies, examples, and tools available for collecting, 
summarizing, and using fidelity and outcome data to engage in iterative decision- 
making and problem-solving. All figures and mentions of specific strategies in 
Recommendation 4 are offered as examples only and should not be read as 
endorsements of specific approaches or products. 


The guidance below is informed by the studies that support the recommendation, as 
well as the expert panel’s expertise and knowledge of resources and strategies 
available to help implement the recommendation. 
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FIGURE 4.1: Steps to Implement Recommendation 4 


Establish a multidisciplinary, problem-solving team focused on promoting 
prosocial behavior. 


Ensure that the requisite data systems are in place for regularly collecting, 
reporting, and analyzing fidelity and outcome data. 


Identify problems requiring a solution. 


Identify a goal and solution for resolving the problem. 


Implement and monitor the proposed solution. 


Monitor the solution’s impact and decide next steps. 


1. Establish a multidisciplinary, problem-solving team focused on promoting prosocial 
behavior. 


Multidisciplinary representative teams should establish a problem-solving team that 
will use data to identify and analyze problems, identify solutions and the associated 
implementation processes to enable those solutions, and evaluate the effectiveness of 
the solutions related to student outcomes. As with the multidisciplinary 
representative team, the membership of the problem-solving team should incorporate 
diverse stakeholder perspectives. The establishment of a multidisciplinary, problem- 
solving team should be preceded by the questions identified in Figure 2.2. of 
Recommendation 2 to determine whether the multidisciplinary representative team, 
or a subset of its members, could fulfill the key roles of a problem-solving team. In 
particular, questions such as “Do you need a new team?” and “Do you need to add any 
additional members to your team?” will help to reduce duplication of efforts, minimize 
the burden on staff, and ensure that the problem-solving team consists of members 


Promoting Social and Behavioral Success for Learning in Elementary Schools 76 


with diverse perspectives who have the requisite experience in working with data and 
engaging in structured decision-making processes. 


Regularly scheduled meetings attended by all members of the problem-solving team 
provide a forum for teams to conduct the important work of using data-based 
decision-making to improve student outcomes. Given the meetings’ importance, 
articulation of clearly defined roles and expectations regarding meeting attendance 
may be necessary to ensure that team members have a clear understanding of 
expectations. Frameworks such as Team-Initiated Problem-Solving (TIPS) offer a 
structured approach to conducting effective and efficient meetings through the use of 
consistent procedures, defined team member roles, and meeting minutes guides (see 
Figure 4.2). During the meetings, the team engages in an iterative, multi-step 
problem-solving process that involves the following components: 


e Identify problems and corresponding goals 

e Select solutions and accompanying implementation plans 

e Implement solutions with a high degree of fidelity 

e Monitor the impacts of solutions against their corresponding goals 
e Make a decision based on summative evaluations 
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FIGURE 4.2: TIPS Meeting Minutes Guide 
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SOURCE: Adapted from Todd et al. (2015). 


2. Ensure that the requisite data systems are in place for regularly collecting, 
reporting, and analyzing fidelity and outcome data. 


Multidisciplinary problem-solving teams require access to data systems that will allow 
them to view multiple data sources to define a problem precisely and build a practical 
solution. Data systems that provide relevant, usable, valid, and accessible data for 
identifying that a problem exists and that allow problem-solving teams to drill down at 
multiple levels'* to precisely define specific problems are vital for informing decision- 
making, monitoring progress, and engaging in action planning. Moreover, data 
systems that prioritize efficiency of data entry and ease of data reporting are likely to 
have significant appeal for school and district personnel. 
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Implementation fidelity data systems can support teams in regularly collecting fidelity 
data using paper or electronic versions of validated fidelity tools."° Further details are 
provided in subsequent steps about a variety of tools that exist for assessing practice 
implementation fidelity." Continuous assessment of implementation fidelity allows 
teams to monitor whether practices are implemented with high fidelity and to quickly 
address instances in which processes may need to be revised to ensure high fidelity. 


Data systems also require sufficient capacity for regularly collecting and analyzing the 
requisite data on student behavior, office disciplinary referrals, outcomes, and school 
climate. When possible, sufficient details should be collected about office disciplinary 
referrals. Sufficient detail means including data elements such as dates, names of 
students and referring staff, location, behavior and perceived motivation, and actions 
taken; these details will support teams in examining implementation fidelity and the 
effectiveness of practices. In addition, data systems that generate efficient, 
modernized, and accessible reports on outcome data support problem-solving teams 
in effectively identifying problems. Finally, data system features for easily 
disaggregating data by race and ethnicity offer a valuable tool for examining the 
enduring challenge of disproportionality in discipline. 


Figures 4.3 and 4.4 provide examples of the types of data reports that are likely to 
meet the needs of problem-solving teams. Figure 4.3 provides an example of a report 
that a problem-solving team could use to determine whether problem behaviors were 
too frequent, and this report could inform the team’s subsequent efforts to examine 
the problem, identify associated goals and solutions, and implement and monitor the 
solution’s impacts. Figure 4.4 provides a pair of examples, ranging from the simple to 
the more advanced, with key metrics (e.g., risk ratios) that a problem-solving team 
could utilize to compare rates of discipline disproportionality across racial and ethnic 


groups. 
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FIGURE 4.3: Example of a Problem Behavior Report from the School-Wide 
Information System‘ 
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SOURCE: Adapted from May et al. (2021). 
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FIGURE 4.4: Examples of Reports That Problem-Solving Teams Can Use to 
Examine Discipline Disproportionality' 


# of Students within 
Ethnicity with 
Referrals 


# of Enrolled # of Students with 
Students Referrals 


Student Enrollment by Race | Black —_—Native Asian bested Multiracial 


Black Native Latino Asian Pacific stuitiracial 
Islander 


Office Discipline Referral by 
Race (# of students with 
ODR) 


0 
% age of enrolled students 0.59 0.40 0,82 0.48 0.60 0.67 
with ODRs aa race 


Risk Ratio forODR Ratio for ODR 


SOURCE: Adapted from McIntosh et al. (2014). 
3. Identify problems requiring a solution. 


With a multidisciplinary problem-solving team and the requisite data systems to 
collect data consistently, schools can engage in robust, data-driven problem-solving 
approaches. Employing a structured approach to problem identification will allow 
teams to precisely identify the problem'® they need to solve. As they undertake a 
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structured approach to problem-solving, teams may want to consider asking the “Big 
6 Questions About Problem Behaviors” identified in Recommendation 2: 


What types of problem behaviors are occurring? 

How often do these problem behaviors occur? 

Where are the problem behaviors occurring? 

When are the problem behaviors occurring? 

Who are the students experiencing the behavior problems? 

Why does the problem behavior continue to occur in these situations? 


AM AWN DO 


Answering these questions will allow the team to clearly describe the nature of the 
problem and justify its importance. Teams can then begin to consider goals and 
identify solutions for resolving the problem. 


4. Identify a goal and solution for resolving the problem. 


After precisely defining the problem, problem-solving teams can then identify a goal 
for resolving the problem. Key factors for teams to consider when setting goals 
include describing what success looks like, how to know when a problem has been 
resolved, and the estimated amount of time required to achieve the goal. Setting 
realistic and achievable goals is important, and teams may want to ensure that they 
develop SMART goals embodying the following characteristics: 


e Specific: What will be accomplished? What actions will be taken? 

e Measurable: What are the data used to measure the goal? 

e Achievable: Is the goal attainable? Does the team have the necessary skills and 
resources? 

e Relevant: Why is the result important? How does the goal align with broader goals? 

e Time-bound: What is the timeline for achieving the goal? 


After identifying a goal, the next step consists of identifying evidence-based solutions 
for addressing the problem and achieving the stated goal. During this process, teams 

brainstorm and evaluate potential solutions. Factors that teams may want to consider 
when discussing solutions include the following:'* 


e Prevention strategies 
e Instructional approaches 
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e Opportunities for recognizing desired behaviors 
e Approaches to stopping unwanted behaviors 
e Strategies for delivering consequences for unwanted behaviors 


Whenever possible, potential solutions should be supported by the best-available 
evidence that documents meaningful change in student outcomes in similar settings. 
Evaluating various solutions is a complex process; exploration and planning tools, 
such as the Hexagon Discussion and Analysis Tool!® (see Figure 4.5), offer teams a 
structured approach to evaluating new and existing practices for promoting prosocial 
behavior. These planning tools guide teams through this complex process by assessing 
the associated evidence, supports, and usability of a proposed solution while also 
assessing the extent to which the solution aligns with population needs, fit, and 
capacity. Throughout their exploration, teams may identify a number of potential 
solutions, but they should consider implementing a few targeted and specific 
solutions rather than too many solutions that cannot be readily maintained.'° 
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FIGURE 4.5: The Hexagon Discussion and Analysis Tool 


The Hexagon: An Exploration Tool 

The Hexagon can be used as a planning tool to guide selection and assess the fit and feasibility 
of potential programs and practices for use. It includes three program indicators and three 
implementating site indicators. 


¢ Identification of focus population 
and subpopulations 


« Use of multiple data sources and 
disaggregated data to understand 
needs and assets 


« Community perception of needs 
and assets 


SUPPORTS 


¢ Expert assistanc 
P Ee EVIDENCE 


+ External resources for 
implementing sites 


* Outcome, 
fidelity and 
cost effectiveness 
data 


* Strength of 
evidence: 
for whom and in 
what conditions 


SUPPORTS 


CAPACITY 


* Implementation 
costs 


« Resources needed 
and available for 
implementation 


« Fit with community 


+ Well-defined program values, culture and history 


« Adaptations for context « Impact on other initiatives 


and populations « Alignment with other 
priorities of the 
implementing site 


NATIONAL IMPLEMENTATION 


O NIRN | kesearch werworx 


FRANK PORTER GRAHAM CHILD DEVELOPMENT INSTITUTE 


SOURCE: Metz and Louison (2019). 
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5. Implement and monitor the proposed solution. 


After identifying a proposed solution, teams should develop a detailed plan for 
implementing and sustaining the associated practices. This process involves 
identifying and documenting the implementation steps, including the associated 
timeline and who is responsible for various components of the plan. The plan should 
also clearly articulate the requirements for high implementation fidelity to ensure that 
the necessary structures and systems are in place to support fidelity and guarantee 
that students experience the maximum benefits associated with the highest degree of 
implementation fidelity.” Depending on the scope of the problem, teams may need to 
develop a multiyear action plan for implementing and monitoring the intervention 
over the first year and at intermediate (i.e., 2 to 4 years) and long-term (i.e., 5 or more 
years) intervals. 


Teams can utilize a variety of validated tools to monitor implementation fidelity. 
These tools collect data from multiple stakeholders to assess whether solutions are 
being implemented with high integrity and can provide an accountability mechanism 
for ensuring that schools are adhering to their action plans. Critically, these tools 
provide teams with the pivotal data required to support sustainability and subsequent 
scaling efforts.'°* Table 4 provides a brief overview of prominent, valid, and reliable 
tools that can be used to assess implementation fidelity. 
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TABLE 4: Implementation Fidelity Tools 


Number 


4 Kore) | stitenis Intended Use Respondents Response Process 

Benchmarks of 53 Initial assessment; annual SWPBIS team SWPBIS team and coach Annually 70% on total 
Quality (Kincaid et evaluation; index for members and complete independently, 
al. 2010) sustaining implementation internal or then coach aggregates into 

fidelity; metric for recognizing | external coach final scores 

high fidelity implementation 
Implementation 44 Track implementation of SWBPIS coach or Coach or external technical Semi-annually For a school to progress 
Phases Inventory school-wide supports in a external technical | assistance provider (October and __ through the four successive 
(Bradshaw et al. phased approach, consistent assistance completes using their April) phases, a score of 80% must be 
2009) with the stages-of-change provider knowledge of the school attained on each phase before 

transtheoretical model moving to the next 
PBIS Self-Assessment | 18 (School- | Determine staff perceptions All school staff Individual staff responses are Annually to 80% on School-Wide Systems 
Survey (Sugai et al. Wide on fidelity; conduct needs members averaged by school triennially Implementation Average 
2000) Systems assessment for next steps in 

scale) implementation 
School-wide 28 Annual evaluation External evaluator | Evaluator completes based Annually 80% on both Behavioral 
Evaluation Tool on student and staff Expectations Taught subscale 
(Horner et al. 2004) interviews, school and total 
walkthrough, and permanent 
product review 

Team 22 Progress monitoring and SWPBIS team SWPBIS team completes 3-4times per 80% on total 
Implementation action planning during initial | members collaboratively year 
Checklist (Sugai et implementation 
al. 2001) 
Tiered Fidelity 15 (Tier 1 Progress monitoring, annual SWPBIS team Team and coach complete At least 70% on Tier 1 scale 
Inventory (Algozzine | scale) evaluation, and action members with collaboratively based on annually 
et al. 2014) planning external coach student and staff interviews, 


school walkthrough, and 
permanent product review 


SOURCE: Adapted from Mercer et al. (2017) and Bradshaw et al. (2009). 
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Teams may want to consider several important factors while using implementation 
fidelity tools.'*° Using tools to obtain baseline data on the extent to which specific 
elements of a strategy or practice are in place can provide administrators, coaches, 
and trainers with valuable information about existing strengths and weaknesses of 
strategies and practices, and these individuals can use this information to target 
training efforts more effectively. Recommendation 1 discussed the importance of 
conducting implementation fidelity checks on a regular basis (whether monthly, 
quarterly, or bi-annually) to monitor progress over time and determine whether 
practice components are being effectively maintained over time. Implementation 
fidelity data provide important feedback to teams and school personnel on the status 
of prosocial behavior practices. In addition, providing school personnel with 
summary and disaggregated fidelity data on a regular basis can help reduce the time 
required to achieve effective implementation. Fidelity data should be framed in a 
positive manner, and representative multidisciplinary teams may need to 
communicate to other stakeholders that the data demonstrate progress toward the 
stated goal. As such, the data provide opportunities to acknowledge high-quality 
implementation and recognize the school’s accomplishment of various 
implementation steps. 


6. Monitor the solution’s impact and decide next steps. 


In the final step, problem-solving teams utilize outcome data to determine whether 
the solution is having the desired impact on the outcome. The data should drive team 
decisions about whether the goal has been met, progress has been made, or the 
problem has gotten worse. Monitoring a solution’s impact involves reviewing outcome 
data on a regular basis (e.g., monthly or quarterly). These data, in combination with 
fidelity data, provide an opportunity for teams to adjust the solution or its 
components as needed. 


Summative evaluations conducted at the end of the action plan will allow teams to 
make a final assessment of whether the solution had the requisite impact and 
achieved the stated goal. Problem-solving teams, in consultation with 
multidisciplinary representative teams, will need to consider how to proceed based 
on the results of the summative evaluation. Successful solutions could warrant further 
discussions regarding sustainability and scaling.'”° In contrast, solutions that did not 
achieve the stated goal may require further discussion about whether the school 
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should continue working toward the goal, whether implementation was an issue, 
whether modifications may be needed to achieve success, or whether a goal should be 
further revised. Critically, the completion of this final step should be followed by a 
restarting of the problem-solving process, with the problem-solving team using data to 
identify new problems that require a solution. 


Potential Obstacles and the Panel’s Advice 
OBSTACLE: There may be unintended consequences of data collection. 


PANEL’S ADVICE: Data offer a variety of benefits for problem-solving processes and 
the ultimate pursuit of practices that promote prosocial behavior; however, student- 
or classroom-level data can have adverse impacts for students and their educators 
when accessed by unauthorized users or when improperly used by authorized users. 
Accordingly, educators and staff may be hesitant to collect data without assurances of 
how the data will be protected and shared with other stakeholders. Clear 
communication about the benefits of data collection, intended use of the data, and 
discussion of when the school collects official data for problem-solving can help 
address the justifiable concerns of educators and staff. Providing training on the data 
systems used to securely collect confidential data and report data at aggregated levels 
(e.g., by grade level) can instill confidence that data will only be used in a constructive 
and professional manner. 


OBSTACLE: Data collected by educators and school staff may lack consistency. 


PANEL’S ADVICE: Regularly scheduled, consistent collection of data can be a 
challenging endeavor across multiple stakeholders. For instance, some educators may 
elect to report only major behavior incidents, while others may only report minor 
incidents. Clear data collection standards and requirements are a foundational 
component for achieving data collection consistency. Problem-solving teams should 
strive for clear definitions of behavioral and student outcome data (e.g., office 
disciplinary referrals) so that educators and staff have a clear understanding of the 
requirements for collecting consistent and accurate data (see Recommendation 2 for 
strategies for defining major and minor behavioral issues and consistently collecting 
these data). Additional coaching focused on data collection consistency can be a 
helpful resource for individuals struggling with collecting data consistently (refer to 
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Recommendation 3 for detailed information on how individualized coaching could 
be used to support consistent data collection). 


Schools should seek to adopt user-friendly data systems that make the data entry 
process efficient and enjoyable to ensure that data are entered routinely and 
consistently. Data systems that combine ease of data reporting with options for 
aggregating and disaggregating data across key subpopulations and time periods (e.g., 
by race/ethnicity or grade level; or by monthly, quarterly, or annual time periods) can 
further ensure that data are reported consistently at all levels. The use of school-wide 
data systems,’ such as the School-Wide Information System (SWIS), DIBELS, and 
aimswebPlus, can also help reinforce consistency by ensuring that data entry is 
standardized. 


OBSTACLE: Increased data use may feel overwhelming and school personnel may not 
know where to begin. 


PANEL’S ADVICE: Several approaches can ease schools into the process of using data 
and can help build support for the widespread use of data. Action plans or 
blueprints!” can offer an invaluable tool by breaking the process associated with 
increased data use into manageable steps. Another approach involves the use of user- 
friendly data collection tools,” such as the example in Figure 4.6, that allow 
educators and staff to share information on their practices or their perceptions about 
school climate. The user-friendly nature of these tools can underscore the utility of 
data collection and demonstrate the intended culture of increased data use. 
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FIGURE 4.6: Treatment Integrity for Elementary Settings (TIES) - Teacher 
Report Form 


Teacher's name: School: Focal Student Name: Today's 
Date: 


38 


Treatment Integrity for Elementary Settings (TIES) — Teacher Report Form 


= 
z = : : 
° < a = 
1. Did the focal student demonstrate problem behaviors today? 1 3 5 7 
S| Ge) [ap aoe ey ime im! 
2. !helped the focal student develop and/or practice strategies to identify 1 3 5 z 
emotions and/or handle emotions (e.g., frustration tolerance, anger 
management). ooaooae ao 
3. lexpressed warmth and interest in the focal student when listening to and 1 3 5 7 
interacting with him or her. 
Je) (a) [eh eh el |e) [el 
4. |used questions or prompts that seek a specific response {academic or 1 3 5 7 
behavioral) from the focal student (e.g., What color is this?; Can you show me 
how your raise your hand?) Oo0 aq 0ag0 00 
5. | praised the student using behavior specific statements (e.g., Good job! | like 1 3 5 7 
how you are sitting in your seat) in response to an a! riate behavior. 
eae in a ee fe Oa oe 
6. Before a problem behavior is likely to occur | remind the focal student of what 1 3 S 7 
s/he needs to do (e.g., Teacher says “remember to sit down when you get to the oooogodgoea 
carpet” because the focal student often fails to sit down on the carpet square). 
7. | taught and/or reminded the focal student to follow rules and expectations of 1 3 5 7 
the classroom. 
i _ | aan wna OOOog aod 
8. | linked two or more instructional practices when interacting with the focal 1 3 5 7 
student (e.g. opportunity to respond followed by a behavior specific praise 
(e.g. opp ity Pp y pecific p oOoOogogood 


statement). 


Thank You!! 


SOURCE: Sutherland et al. (2020).!4 
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OBSTACLE: Implementing data systems across multiple schools can impose notable 
technology costs. 


PANEL’S ADVICE: Although there are numerous benefits of implementing a data- 
based problem-solving approach, the initial and ongoing costs of using data systems 
may seem formidable. The costs associated with district-wide data systems can range 
from reasonably modest to significant depending upon factors such as whether 
districts decide to purchase data systems or buy access to systems and the extent to 
which districts have already invested in the hardware and databases needed to 
operate data systems. However, the combination of implementation planning, a 
phased approach, and resource leveraging" can support districts in their pursuit of 
implementing data systems across schools. District implementation plans provide an 
important venue for outlining the processes for implementing a problem-solving 
approach while also articulating the need for additional funding, policy adaptations, 
and resource reallocations needed to implement data systems. A phased approach 
including pilot demonstrations of data systems can help demonstrate utility and 
highlight the need for additional resources to support scalability. Moreover, resource 
leveraging can be an important concept for districts to embrace. Resource leveraging 
is the process by which initial investments in personnel, materials, and events to 
achieve a targeted goal result in outcomes that lead to subsequent investment toward 
the goal.!”° With its focus on planning and management of initial resources, resource 
leveraging can improve districts’ ability to scale up the use of data systems vital for 
supporting effective practices to promote prosocial behavior. Please refer to 
Recommendation 5 for further details on how districts can implement 
organizational systems, including data systems, to support the use of prosocial 
behavior practices. 
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RECOMMENDATION 5: Implement the Organizational 
Systems Needed to Support the Initial Adoption and 
Sustained Use of Effective Practices with High Fidelity. 


The implementation of practices for promoting prosocial behavior is influenced by an 
array of interdependent factors at the educator, school, district, and state levels.'”” 
Although this guide focuses primarily on whole-class and whole-school efforts, it is 
important to reiterate that systems and supports at the district or state levels play a 
pivotal role in the adoption and sustained use of prosocial behavior supports at the 
school level.'”® Notably, educational research has focused less on the role of district- 
and state-level organizational systems in promoting prosocial behavior compared to 
its focus on classroom and school-wide strategies and frameworks. However, 
appreciation for the role of district- and state-level organizational systems has 
increased in recent years, and the panel brings attention to the need to focus on the 
role of district- and state-level organizational systems. 


School-level implementation is more likely to be successful when it is supported at the 
district or state levels,’ as districts and states can help create a shared vision, 
language, and experience for implementing practices while also working to improve 
resource efficiency, implementation efforts, and organizational management across 
schools. Accordingly, there is a need for equal emphasis on the systems and 
organizational supports, at the district or state level, that are necessary for accurate 
and sustained implementation of practices at the school level.'®° Districts and states 
offer a key leverage point for improving student outcomes and can provide a 
multiplier effect for scaling effective evidence-based practices.'*' Recommendations 1 
and 2 emphasize the importance of establishing multidisciplinary representative 
leadership teams within schools to provide leadership for the development, 
implementation, and sustainment of positive behavioral expectations for all students. 
Districts and states can take a similar approach: establishing multidisciplinary, 
representative leadership teams to coordinate the adoption and sustained use of 
effective practices across schools by helping to build capacity and providing a 
supportive context for schools to implement effective practices. At the district or state 
level, these leadership teams can lead by engaging diverse stakeholders, working to 
align and leverage funding and resources,‘ ensuring policy support, and 
strengthening workforce capacity. In addition, the representative leadership team can 
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help to influence and increase school-level capacity to implement effective practices 
by focusing on training, coaching (Recommendation 3), and evaluation. These 
organizational systems and supports can produce broader educational change 
through increased promotion of evidence-based practices that fit individual schools’ 
needs and cultures, greater investment in the systems and resources necessary for 
supporting adoption and sustained used of practices, and a comprehensive 
implementation plan with the associated stages for achieving high implementation 
fidelity. 


Recommendation 5 was informed by two studies of the effectiveness of implementing 
organizational systems at the district or state levels to support the adoption and 
sustainment of effective practices with high fidelity. One of the studies meets WWC 
group design standards without reservations,'** while the other study meets WWC 
group design standards with reservations.'* In the two studies used to support 
Recommendation 5, implementing the organizational systems for adopting and 
sustaining prosocial behavior practices was a major component of the tested 
intervention. 


The panel has confidence in the research suggesting that implementing the 
organizational systems will support the initial adoption and sustained use of effective 
practices with high fidelity. See Appendix C for detailed descriptions of the 
intervention features and findings from each study informing this 
recommendation. 


How to Carry Out the Recommendation 


This section describes strategies, examples, and tools available for implementing the 
organizational systems for adopting and sustaining prosocial behavior practices. All 
figures and mentions of specific coaching strategies in Recommendation 5 are 
offered as examples only and should not be read as endorsements of specific products 
or approaches. 


The guidance below is informed by the studies that support the recommendation, as 
well as the expert panel’s expertise and knowledge of resources and strategies 
available to help implement the recommendation. 
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FIGURE 5.1: Steps to Implement Recommendation 5 


Establish a multidisciplinary, representative district or state leadership team 
and develop a comprehensive action plan. 


Actively engage stakeholders in efforts to build school-level capacity. 


Align prosocial behavior practices with existing initiatives, resources, and 
funding. 


Adopt policies that describe the rationale and provide clear support for 
practices promoting prosocial behavior. 


Strengthen the workforce capacity to implement and sustain prosocial 
behavior practices. 

Increase district- or state-wide capacity for implementation functions by 
investing in implementation drivers. 


1. Establish a multidisciplinary, representative district or state leadership team and 
develop a comprehensive action plan. 


Districts and states should establish a multidisciplinary, representative leadership 
team responsible for directing efforts to build capacity at the school level by providing 
the necessary systems and supports for implementing prosocial behavior practices. 
The district or state multidisciplinary leadership team should represent a wide range 
of stakeholders including general and special education teachers; families; community 
members with a vested interest in student outcomes; and individuals with in-depth 
knowledge of the training, coaching, and evaluation practices and systems critical for 
implementing prosocial behavior practices with high fidelity. Early discussions that 
focus on establishing a multidisciplinary, representative leadership team should 
employ the questions identified in Figure 2.2 of Recommendation 2 to determine 
whether a new team is necessary, whether an existing leadership team could fulfill 
these key roles, and whether any additional members should be added to the team. 
Upon establishing the representative leadership team, team members should 
designate a coordinator to facilitate the team’s efforts. This individual should have the 
requisite time and availability to fulfill this role, prior experience in using data to 
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guide problem-solving and decision-making, and the authority to implement decisions 
in relation to other team members. 


The goal of the district or state leadership team will be to develop the organizational 
systems and supports needed to implement and sustain practices with a focus on 
engaging stakeholders, aligning resources, adopting supportive policies, building 
workforce capacity, and increasing implementation capacity. To achieve these goals, 
the leadership team should have the authority to make key decisions pertaining to 
budgets, policies, data systems, and implementation. A key initiative for the 
leadership team will be developing a comprehensive action plan to build and sustain 
the capacity for implementing prosocial behavior practices across schools over a 3- to 
5-year period. As the teams begin developing comprehensive action plans, they may 
want to utilize established tools such as the District Systems Fidelity Inventory'*® or 
the State Systems Fidelity Inventory,'*® which provide a structured approach for 
conducting initial action planning, monitoring progress, and conducting annual 
evaluations of implementation fidelity and impacts on student outcomes. Once 
developed, the action plan will serve as a key resource for guiding the team’s 
subsequent efforts. The leadership team should strive to hold meetings monthly to 
review progress on the action plan and the components described in the following 
steps. Finally, a key benefit of developing the plan is that the systems and supports 
articulated in the plan can be efficiently and effectively incorporated into other 
strategic plans developed by districts and states. 


2. Actively engage stakeholders in efforts to build school-level capacity. 


Active engagement of stakeholders who have an interest in or are impacted by 
prosocial behavior practices is necessary to support development of organizational 
systems and supports needed to implement effective practices with high fidelity. 
District or state leadership teams should seek to engage students and family members, 
educators, school boards, and community members in efforts to build school-level 
capacity. A comprehensive, written engagement plan will ensure that stakeholder 
engagement processes are effectively deployed, and that the leadership team is 
regularly communicating data, information, and accomplishments to stakeholders. 
Members of the district or state leadership teams can help support active stakeholder 
engagement efforts by visiting implementation schools and communicating progress 
at various events and activities. 
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3. Align prosocial behavior practices with existing practices, resources, and funding. 


Schools, districts, and states operate in an environment of scarce resources and 
competing demands. As such, district or state leadership teams should carefully 
consider the resources that their proposed practices require to achieve the desired 
outcomes for students. Resource-mapping tools, careful consideration of and 
alignment with existing practices (i.e., school-level interventions or district- or state- 
level initiatives), and development of a comprehensive budget plan are critical 
resources that districts, and states can utilize to implement, sustain, and scale 
prosocial behavior practices. Resource-mapping tools, such as the one in Figure 5.2, 
can assist district or state leadership teams in systematically assessing the resources 
available for implementing practices while also identifying resource gaps. This process 
of graphically mapping resources can assist district or state leadership teams to better 
understand available resources and to organize these resources into a standardized 
and accessible format.!®” 
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FIGURE 5.2: School-Level Intervention Mapping Tool 


The purpose of this tool is to (a) provide an overall picture of existing social emotional behavioral initiatives available to the larger community, 
(b) determine the effectiveness, relevance, and fidelity for each, (c) determine funding and resource allocation, and (d) determine areas of 
redundancy. This process is led by the multidisciplinary representative district or state leadership team. 


What is the connection 


What professional 


to the mission of the What personnel are What is the ynat What is the financial nat development exists 
Name of eee i 3 evidence of . fidelity : 3 é 
Initative BE IS Lita ; involved in ut expected Be earn commitment and eee (including coaching 
representative implementation? outcome? source of funding? : and performance 
| there so far? exist? 
leadership team? feedback)? 
PBIS School climate and culture | All staff Reduction in Improved District Coach FTE, Tiered Quarterly 
suspensions, suspension, stipends for building Fidelity coaching for 
ODRs, ODR, and coaches, and Inventory building coaches; 
restrictive restrictive professional Professional 
placements placements development development for 
new staff; 
Ongoing professional 
development and 
coaching for all 
staff 
Social School climate and culture | School counselors Improved skills | Reduction in Purchasing curriculum | Self-report None 
Emotional through social and social workers for students in ODRs from last | plans for each grade of counselor 
Behavioral emotional learning grades K-5 school year level and professional or social 
Skills development for worker 
Curriculum integrating into 
academic content 
Other tools 
cont. 


SOURCE: Adapted from Pohlman et al. (2019). 
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After completing a resource map, district or state leadership teams can assess how the 
identified resources align with other practices by carefully considering how resources 
could be used to sustain implementation of the proposed practice. During this step, 
district or state leadership teams can use conceptual maps, diagrams, and other tools 
to clearly describe how the practices and the associated resources align with other 
interventions and initiatives with similar goals, systems, and practices.'** This 
approach will allow district or state leadership teams to identify opportunities for 
integrated and/or collaborative implementation that can support long-term 
sustainability. 


The development of a district or state budget plan with prioritized funding for 
supporting organizational systems and capacity-building activities is a critical 
requirement for supporting schools in implementing, sustaining, and scaling prosocial 
behavior practices.'*° When developing budget plans, districts and states may find it 
helpful to consider resource leveraging,’ or the process by which the outcomes from 
initial resource investments in personnel, materials, and events to achieve a targeted 
goal result in subsequent investments toward the goal. Articulation of the short, 
intermediate-, and long-term funding requirements within budget plans will provide 
critical support for achieving initial implementation of the practices, in addition to 
communicating the need for additional funding and resource reallocations that may 
be necessary to sustain the practices and take them to scale.’ A variety of resources, 
such as the SEL Financial Sustainability Toolkit, can be used by district or state 
leadership teams to develop budget plans. These resources include cost calculators to 
estimate implementation and sustainability costs, a financial sustainability planning 
tool, and a budget planning tool (see Figure 5.3) that can be used to develop budgets 
and plan funding sources over a 6-year period. 
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FIGURE 5.3: Social and Emotional Learning Budget Planning Tool 


Year2 Year3 Year4 YearS Year6 


Prosocial Behavior Director/Coordinator (salary and benefits) 


Prosocial Behavior Specialists (salary and benefits) 
Other Positions (salary and benefits) 
Administrative Assistant (salary and benefits) 
Professional development pay, stipends, substitutes 


SOURCE: Adapted from Collaborative for Academic, Social, and Emotional Learning (CASEL, n.d.). 


Even after a district or state budget plan is adopted, district or state leadership teams 
should continue to assess alignment on a regular basis and as other practices are 
adopted. Conducting periodic formal alignment reviews will assist district or state 
leadership teams in assessing whether their practices, as implemented, continue to 
align with other initiatives and interventions. As new practices are proposed and 
selected, district or state leadership teams should conduct alignment reviews prior to 
the adoption of the new practices. These reviews will provide an opportunity to 
examine the alignment of goals, systems, and practices and identify opportunities for 
further alignment and integration. 
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4, Adopt policies that describe the rationale and provide clear support for practices 
promoting prosocial behavior. 


District and state policies provide a critical opportunity to convey the need, 
importance, and benefits of prosocial behavior practices, articulate formal support for 
the practices, and emphasize the need to implement these practices with high fidelity. 
A variety of policy documents (e.g., mission statements, instructional approaches, 
disciplinary guides, and written transition plans) can be used to establish that the 
social behavior of students is one of the core functions of schools, convey the need for 
the new practice, and articulate that the outcomes of the practices are a core goal of 
the district and/or state. District or state leadership teams may want to begin by 
developing or updating their mission statements to convey the rationale for adopting 
prosocial behavior practices, describing the long-term outcomes for students, and 
including an endorsement from district- and/or state-level administrators.'°” 


District and state policies, along with the associated procedures outlined in 
documents such as student handbooks and codes of conduct, can describe and 
emphasize the use of the practices in instructional approaches and restate the need 
for consistently implementing these practices with fidelity. District or state leadership 
teams can also regularly review their disciplinary policies and procedural guides to 
reflect the transition from reactive or punitive consequences to practices promoting 
prosocial behavior and then redistribute the updated guides to stakeholders. Finally, 
district or state leadership teams may want to consider developing a written transition 
plan detailing the policies and supports to assist students in acclimating to prosocial 
behavior practices. 


5. Strengthen the workforce capacity to implement and sustain prosocial behavior 
practices. 


The success of evidence-based prosocial behavior practices depends on personnel 
(including superintendents, administrators, coaches, educators, and support staff) 
having the capacity to implement and sustain prosocial behavior practices; in other 
words, personnel must have the right knowledge, skills, and experience to use new 
behavior practices effectively. Accordingly, district or state leadership teams can help 
strengthen the workforce’s capacity by using procedures designed to ensure that 
existing and future staff have the capacity to implement and sustain practices. Given 
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district or state leadership teams’ role in directing capacity-building efforts for 
implementing school-level practices, these teams can provide valuable guidance to 
schools on criteria for hiring, recruiting, and selecting personnel who have the 
necessary knowledge, skillset, and experience with prosocial behavior practices. 
District or state leadership teams can also assist with incorporating prosocial behavior 
practices and associated implementation activities into job descriptions as another 
opportunity for strengthening workforce capacity. Annual performance evaluations 
can be another opportunity to assess staff knowledge and skills of prosocial behavior 
and to identify opportunities for additional training, professional development, and 
coaching on implementing prosocial behavior practices within their respective 
positions (see Recommendation 3). 


6. Increase district- or state-wide capacity for implementation functions by investing 
in implementation drivers. 


The previous recommendations focus on key drivers for implementing prosocial 
behavior practices at the school level. Recommendations 1 through 4 illustrate the 
vital importance of collecting and analyzing fidelity and outcome data and how data 
allow schools to effectively diagnose problems, determine which practices are most 
effective, and assess how practices are improving student outcomes. 
Recommendation 3 emphasizes the importance of coaching in conjunction with 
training and other professional development activities for ensuring that school-based 
implementers have the motivation, knowledge, and skills to implement evidence- 
based instructional and classroom management practices. Similar to their school-level 
counterparts, district or state leadership teams can ensure high fidelity and 
sustainable implementation of prosocial behavior practices by investing in 
implementation drivers, the key components of capacity and infrastructure that 
influence classroom-, school-, and district-level change.’ Training, coaching, and 
evaluation are three implementation drivers™ of particular import for bolstering 
implementation across schools. By investing in these drivers, district or state 
leadership teams can ensure that educators, staff, and administrators have the 
capabilities to implement practices as intended. 
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Training 


Investing in training not only ensures that school-level implementers obtain an in- 
depth knowledge of prosocial practices, but training investments also provide a key 
professional development opportunity for strengthening instructional and classroom 
management skills that result in effective teaching. To support investment in training, 
district or state leadership teams can assist with establishing resources and systems 
for training schools at the local level. These resources and systems include 
understanding professional development needs, developing a training action plan, 
supporting efforts to build local training capacity, and adopting effective training 
activities. Training activities should focus on providing educators, administrators, and 
staff with the necessary knowledge to successfully implement new practices. Prosocial 
behavior trainings should accomplish the following:'* 


e Provide information on the theory, philosophy, values, and rationales for 
practices 

e Use training processes grounded in adult learning theory to actively engage 
participants 

e Introduce the components of the practice and the associated rationale 

e Provide opportunities to practice new skills and receive feedback within a 
supportive training environment 


Coaching 


Recommendation 3 discussed in detail how coaching can build on the foundation 
provided by training activities by offering important opportunities for staff to practice 
and master key skills while exercising their job duties. District or state leadership 
teams can guide the development and implementation of coaching service delivery 
plans’ that describe the process, skills, frequency, location, associated time periods, 
and measures for examining coaching effectiveness. Differentiated coaching supports 
can bolster effective implementation through providing specialized support across 
personnel types or through addressing specific needs identified by data. 


The coaching processes developed by districts and states should encourage schools to 
use multiple data sources to support school-level practitioners in implementing 
practices with fidelity; these data sources include direct observations, practitioner 
perspectives, and fidelity and outcome data. Coaching data and feedback from 
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coaches can inform further training improvements and identify opportunities to 
improve organizational systems and supports. Furthermore, updating coaching 
service delivery plans can support continuous quality improvement efforts. 


Data 


As discussed in detail under Recommendation 4, investing in evaluation capacity 
and data systems is vital for continuously assessing implementation fidelity and the 
effectiveness of practices on student outcomes. District or state leadership teams can 
support districts and states in developing evaluation plans that specify the methods 
used to evaluate progress and that detail how data may be used to adapt or update 
action plans as practices are determined to be effective or in need of modification. 
Evaluation plans should align with the 3- to 5-year comprehensive action plans 
developed by the district or state leadership team and should articulate a process and 
schedule for conducting evaluations at the classroom, school, and district or state 
levels. Evaluations should focus on understanding implementation fidelity and the 
impacts of prosocial behavior practices on student outcomes. 


District and state evaluation plans should also focus on the importance of 
implementing effective and efficient data collection systems that provide leaders, 
teams, educators, and specialists with the data needed for effective decision-making. 
To guide districts and states in their assessment, selection, and subsequent use of data 
collection systems, district or state leadership teams can identify key requirements. 
Data collection systems should promote consistent collection and entry of common 
data about stakeholder perceptions, implementation fidelity, and outcomes 
disaggregated by subpopulations.” Data collection systems with user-friendly analysis 
and dissemination features can support administrators, specialists, coaches, and 
teams in identifying classrooms or schools requiring additional training and coaching 
support and ensuring that all parties have regular access to the data to engage in 
continuous decision-making and feedback. Finally, aligning evaluation plans with 
training and coaching plans will ensure that administrators, specialists, coaches, and 
teams have the training to effectively use the data collection systems to engage in data- 
based decision-making and problem-solving that improves student outcomes. Access 
to data is insufficient without the organizational structures (e.g., teams) and problem- 
solving protocols that allow educators to develop locally relevant solutions. 
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Potential Obstacles and the Panel’s Advice 


OBSTACLE: Districts and states may implement prosocial behavior practices without 
establishing the necessary organizational systems and support. 


PANEL’S ADVICE: Although districts and states may be eager to begin using prosocial 
behavior practices to improve student outcomes, it is imperative that they engage in 
careful planning using the steps described above to ensure that the systems and 
supports are in place to ensure success. The combination of a representative district 
or state leadership team and a comprehensive action plan, stakeholder engagement, 
alignment of opportunities with existing practices and resources, supportive policies, 
strengthening of workforce capacity, and investment in implementation drivers are 
necessary and sufficient conditions for ensuring that practices are implemented with 
fidelity and are rigorously evaluated to determine their impact on student outcomes. 
In some instances, districts and states may identify an urgent need to address problem 
behaviors, which may justify implementing practices before establishing 
organizational systems and supports. In these situations, the panel recommends that 
districts or states conduct pilot demonstrations to test and refine practices and 
demonstrate their associated feasibility and effectiveness before introducing these 
practices in more schools. 


OBSTACLE: Districts and states may be reluctant to implement prosocial behavior 
practices due to concerns about competing demands for resources within existing 
initiatives and interventions. 


PANEL'S ADVICE: The panel recognizes that districts and states may feel that they do 
not have sufficient resources to implement additional practices. As problems are 
identified through decision-making and problem-solving processes, and as proposed 
solutions are identified, district or state leadership teams may need to carefully 
consider the resource requirements. Established tools such as resource maps, 
conceptual maps, and diagrams for illustrating how proposed practices align with 
other practices, as well as cost calculators and financial sustainability planning tools, 
can assist districts and states in conducting an in-depth analysis of whether additional 
prosocial behavior practices can be implemented effectively. In many instances, this 
deeper analysis may illuminate additional resources or opportunities for alignment 
that had not been considered previously. In instances when the deeper analysis 
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determines that resources and alignment opportunities are limited, districts and 
states may want to consider conducting pilot demonstrations, followed by resource 
leveraging to implement prosocial behavior practices on a wider scale. 


OBSTACLE: Changes in district or state leadership may reduce the support and 
impetus for adopting the organizational systems and supports required to implement 
and sustain prosocial behavior practices. 


PANEL’S ADVICE: Administrative leadership has been identified as a significant 
factor in the successful implementation of practices, and leadership turnover can 
have a considerable impact on the initial adoption and sustainment of practices.!%* 
However, schools and districts can take several approaches to minimize the adverse 
effects associated with leadership changes. For example, the inclusion of prosocial 
behavior practices within mission statements, instructional approaches, disciplinary 
guides, and written transition plans can communicate the need, importance, and 
benefits of the practices to new administrators. Furthermore, developing a 
comprehensive action plan that describes the procedures and processes that will be 
implemented over a 3- to 5-year period can also help mitigate the impacts of 
leadership changes by ensuring that a sustainable plan of action is in place. Finally, 
stakeholder engagement efforts led by the district or state representative leadership 
team can foster new leadership’s continued support by providing administrators an 
opportunity to visit implementing schools, engage with other stakeholders, and 
communicate progress toward achieving key milestones and goals at various events 
and activities. 
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Glossary 


A 


Administrator refers to any person who is in a position of authority or who manages 
people, practices, and policies at a school. 


D 


Does Not Meet What Works Clearinghouse Group Design Standards identifies a 
group design study with a low level of causal evidence. This is the rating given to 


studies with causal research designs that were not implemented rigorously enough to 
conclude with confidence that the intervention caused the observed changes in 
outcomes. 


G 


Group design standards are the set of standards used by the What Works 
Clearinghouse (WWC) to review studies. These standards are used to evaluate the 
strength of the evidence of the effectiveness of educational interventions. Studies are 
given a rating of Meets What Works Clearinghouse Group Design Standards without 
Reservations, Meets What Works Clearinghouse Group Design Standards with 
Reservations, or Does Not Meet What Works Clearinghouse Group Design Standards. 


M 


Meets What Works Clearinghouse Group Design Standards With Reservations 
is the middle possible rating for a group design study reviewed by the WWC. Studies 


receiving this rating provide a lower degree of confidence that an observed effect was 
caused by the intervention. Randomized controlled trials that are not as well 
implemented or have problems with attrition, along with strong quasi-experimental 
designs, may receive this rating. 


Meets What Works Clearinghouse Group Design Standards Without 
Reservations is the highest possible rating for a group design study reviewed by the 
WWC. Studies receiving this rating provide the highest degree of confidence that an 
observed effect was caused by the intervention. Only well-implemented randomized 
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controlled trials that do not have problems with attrition may receive this highest 
rating. 


O 


Outcome domain is a group of closely-related outcomes. A domain is the organizing 
construct for a set of related outcomes through which studies claim effectiveness. For 
example, the WWC alphabetics domain within the Literacy topic includes the 
following outcomes: phonemic and phonological awareness, letter identification, 
print awareness, and phonics. In intervention reports and practice guides, the WWC 
assesses the rigor of evidence on the effectiveness of interventions within each 
domain identified in the review protocol. The intervention rating, improvement 
index, and extent of evidence are determined at the domain level. 


P 


Positive behavior includes observable actions such as self-management, including 
self-monitoring, self-evaluation, self-delivered consequences, self-recruited support; 
social interactions; or other behaviors that yield social and/or instructional benefits in 
a school setting. 


Prosocial behavior is closely related to positive behavior, but for the purposes of this 
review, prosocial behavior refers to observable actions characterized by interacting 
with others, including peers and school staff, and behaving in ways to benefit other 
people. Common examples of prosocial behavior include sharing, volunteering, and 
protecting someone else from bullying. In the context of the classroom and school 
environment, students are presented with both formal instruction such as 
collaborative learning activities, and informal opportunities such as interactions with 
peer groups, relationships with teachers, and play to develop skills that support 
prosocial and positive behavior. Aspects of prosocial skill development that might be 
targeted for this review include those related to underlying social competencies such 
as emotional regulation, perspective-taking, and cognitive and social problem-solving. 


S 


School climate refers to the environment of the school, or classrooms within a 
school. The National Center on Safe Supportive Learning Environments (n.d.) defines 
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the school environment as a school’s “facilities, classrooms, school-based health 
supports, and disciplinary policies and practices.” Aspects of improving the school 
environment include the physical environment, such as reducing overcrowding and 
messaging positive behavior expectations on posters; the relational environment, 
such as improving peer-to-peer communication, or reducing bullying behavior; and 
the instructional environment, such as improving communication practices or 
approaches between students and staff. 


School equity refers to the policies and practices of the school, or classrooms within 
a school, that promote an equal chance of success for all students. School equity can 
be understood in terms of: (1) fairness, whereby personal or social circumstances do 
not prevent students from achieving their academic potential; and (2) inclusion, 
whereby a basic minimum standard is shared by all students regardless of personal 
characteristics (OECD, 2012). School and classroom equity deal with matters such as 
the disproportionality of discipline practice across different racial, ethnic, and special 
education subgroups. Typical assessments of equity entail assessing the rate of 
disciplinary practices such as suspensions across two groups of students within a 
school, or student or staff surveys of their perceptions of equity. 
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Appendix B: Methods and Processes for Developing This 
Guide 


Phase 1: Selecting the Topic and the Panel; Establishing a Review 
Protocol 


EXPERT PANEL. 2M Research, working under contract to the Institute of Education 
Sciences, established a seven-member expert panel to advise on development of this 
guide. The panel consisted of researchers at the forefront of prosocial behavior 
research and practitioners with experience implementing prosocial behavior 
interventions. 


SYSTEMATIC REVIEW PROTOCOL. 2M Research worked with the expert panel to 
develop the systematic review protocol, which states the guide’s purpose and scope. 
The protocol guided the literature search and review effort. The five research 
questions were: 


e Which whole-class or whole-school (Tier 1) practices are effective at supporting 
positive behavior among students in elementary school? 

e Which whole-class or whole-school (Tier 1) practices are effective at supporting 
change in educators’ instructional and disciplinary practices? 

e Which whole-class or whole-school (Tier 1) practices are effective at improving 
the school or classroom environment, including measures of school climate 
and equity? 

e What supports are needed to help educators implement these practices with 
fidelity to promote positive behavior? 

e Are some practices especially effective for students who are identified with 
disabilities or who are at risk of identification for special education services 
while learning in a Tier 1 context? 


The timeframe for the literature search was approximately 10 years, from January 
2008 to December 2019. The eligible sample included participants in a prosocial 
behavior intervention within elementary grade classrooms or schools in the United 
States. These participants had to have been students in grades K-6 or ages 5-11 when 
the intervention was implemented. Eligible study designs included randomized 
controlled trials and quasi-experimental design studies. Studies had to include a 
prosocial behavior intervention in elementary schools with a primary focus on 
prosocial behavior within whole classrooms or schools. Only outcome domains that 
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relate to prosocial behavior were eligible for inclusion. The 10 domains were as 
follows: 


Student Engagement in School 
Compliant Student Behavior 

Student Social Emotional Functioning 
Primary School Academic Achievement 
General Literacy Achievement 

General Mathematics Achievement 
Educator Discipline Practice 

Educator Instructional Practice 


ee ee ee 


. Classroom and School Climate 
10. Classroom and School Equity 


Phase 2: Literature Search and Review 


A targeted yet comprehensive search of electronic databases was conducted by 2M 
Research staff using keywords focused on eligible prosocial behavior components, 
populations, settings, study designs, and outcomes. The search terms are delineated 
in the systematic review protocol. Four electronic databases (American Psychological 
Association’s PsycINFO, EBSCOHost Education Resources Information Center [ERIC], 
MEDLINE PubMed, and Web of Science: Core Collection) were searched between 
August and November 2019. Panel members also recommended studies that could 
potentially contribute to the guide. 


A total of more than 10,875 publications were identified and screened using a 
multistage screening process to determine whether they focused on school-wide 
prosocial behavior interventions and met the eligibility criteria detailed in the 
protocol and described above. This screening process produced 42 eligible studies 
that were reviewed using What Works Clearinghouse (WWC) 4.0 group design 
standards. Studies employing qualitative, descriptive, or single-case designs as well as 
branded interventions were not examined for eligibility. For a study to meet WWC 
standards, at least one contrast must meet WWC standards with or without 
reservations. See Figure B.1. for the number of records that went through the 
screening and eligibility process and the number of studies that were reviewed with 
the corresponding WWC evidence ratings. 
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FIGURE B.1. Studies Identified, Screened, and Reviewed for This Guide 


Records identified 
(n= 10,875) 


Records screened in for Records excluded 


Screening topic relevance (n= 114) (n= 10,761) 


Eligibility Records eligible for review Records ineligible for 


(n= 42) review (n= 72) 


Studies that meet WWC Studies that do not meet 
Standards without WWC Standards (n = 32) 
reservations (n= 3) 


Evidence Rating 


Studies that meet WWC Studies that meet WWC 


Standards with reservations Standards, but are not relevant 
(n=4) to the recommendations 


(n = 3) 


Phase 3: Generating the Recommendations 


2M Research conducted a detailed examination of the studies that meet WWC 
standards to identify practices that played a role in each intervention. The panel 
identified five recommendations that were grounded in evidence provided by the 
seven studies that meet WWC standards. Three of the studies that meet WWC 
standards were not used for generating the recommendations." The panel then 
suggested ideas for carrying out the recommendations based on research. 


Phase 4: Drafting the Guide 


2M Research worked with the panel to further expand and clarify each 
recommendation and how to implement each recommendation. The team then used 
an iterative process to draft the recommendations, soliciting feedback from the panel 
and revising as needed at each stage. 2M Research prepared the technical appendices. 
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Appendix C: Studies Informing the Practice 
Recommendations 


Conducting Reviews of Eligible Studies 


What Works Clearinghouse (WWC)-certified staff reviewed 10 studies to assess the 
quality of evidence supporting whole-school or whole-class prosocial behavior 
interventions, using WWC 4.0 group design standards. Seven out of the 10 studies that 
meet WWC standards inform the recommendations. These studies are bolded in the 


Notes and in the Reference sections. 


Determining Relevance to Recommendations 


Each of the seven studies inform more than one recommendation, as the 
interventions in these studies include more than one practice (or component) for 
improving student and educator outcomes. For example, one multi-component 
intervention might include implementing school-wide procedures for positive 
behavioral expectations (Recommendation 1), implementing school-wide procedures 
to ensure consequences for problem behavior (Recommendation 2), using 
longitudinal data (Recommendation 4), and implementing the organizational systems 
to support adopting and sustaining practices with fidelity (Recommendation 5); 
therefore, an intervention can inform more than one recommendation. 2M Research 
determined which components were prominent in each intervention. Major 
intervention components in each study that meet WWC standards were then assigned 
to the evidence base for the relevant recommendation. Table C.1 presents the 
mapping between each study and the five recommendations. 
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TABLE C.1: Mapping Between Studies and Recommendations 


Recommendation 
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Berg (2018) e e 

Bradshaw et al. (2010) e e e e 

Bradshaw et al. (2018) e e 

Fabiano et al. (2018) e e 

Horner et al. (2018) e ° e e 

Ottmar et al. (2013) ° e 

Pas et al. (2019) e e e e 


Determining Relevant Outcomes 


To simplify and focus the synthesis of evidence, 2M Research worked with the panel 
to identify which outcome domains were relevant for each recommendation. The 
relevant domains for each recommendation are listed in Table C.2. 


The panel drew a notable distinction between proximal and distal outcomes, and, 
ultimately, determined how each type of outcome informed the recommendations. 
Outcomes in the student behavior, educator disciplinary and instructional practices, 
and school environment domains were designated as proximal outcomes on the basis 
that behavioral interventions would be most likely to directly affect these outcomes 
over a shorter time period, as is the case in the studies reviewed for this guide. In 
contrast, academic achievement outcomes (including outcomes in domains of 
primary school academic achievement, general literacy achievement, and general 
mathematics achievement) were characterized as distal outcomes on the basis that 
behavioral interventions would be less likely to directly affect these outcomes in the 
short term but may affect these outcomes over time. Accordingly, the expert panel 
focused on proximal outcomes for student behavior, educator disciplinary and 
instructional practices, and the school environment to develop the evidence ratings 
associated with each recommendation. In contrast, the panel designated academic 
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achievement outcomes (i.e., primary school academic achievement, general literacy 
achievement, and general mathematics achievement outcomes) as a secondary focus. 


Recommendations 1, 2, and 5 align with student outcomes, and Recommendations 3 
and 4 align with student and educator outcomes. No studies that meet WWC 
standards included findings in the school environment domain. The panel and staff 
considered the findings in the predetermined relevant domains to inform each 
recommendation. Only findings in relevant domains are presented in this appendix. 


The two proximal student outcome domains (student compliance behavior and 
student social emotional functioning) are measured at the cluster level, given the 
focus on whole-school or whole-class interventions. The two educator proximal 
outcome domains were measured and analyzed at the individual level. 


In addition, all the distal outcomes (student primary academic achievement, general 
mathematics achievement, and general literacy achievement) were measured and 
analyzed at the cluster level. 


TABLE C.2: Relevant Domains for Each Recommendation 


Recommendation 1, 2, and 5 Recommendation 3 Recommendation 4 


Student outcome domain 

1. Compliant student behavior 
2. Student social emotional 
functioning 

3. Primary school academic 
achievement 

4. General literacy achievement 
5. General mathematics 
achievement 


Student outcome domain 

1. Compliant student behavior 
2. General literacy achievement 
3. General mathematics 
achievement 


Educator outcome domain 
1. Educator discipline practice 
2. Educator instructional 
practice 


Student outcome domain 

1. Compliant student behavior 
2. Student social emotional 
functioning 

3. Primary school academic 
achievement 

4. General literacy achievement 
5. General mathematics 
achievement 

Educator outcome domain 
1. Educator discipline practice 
2. Educator instructional 
practice 


Note: The panel designated academic achievement outcome domains italicized in the 
table (i.e., primary school academic achievement, general literacy achievement, and 
general mathematics achievement) as distal outcome domains on the basis that 
behavioral interventions would be less likely to directly affect these outcomes in the 
short term but may affect these outcomes over time. The non-italicized domains are 
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the proximal outcome domains and the main focus, while the italicized domains are 
distal outcome domains and the secondary focus of this guide. 


Recommendation 1: Implement School-Wide Procedures for Defining, 
Teaching, and Acknowledging a Small Set (e.g. 3-5) of Positive 
Behavioral Expectations. 


Recommendation 1 was informed by five studies of interventions with school-wide 
procedures and practices for positive behavioral expectations. Two of the studies 
meet WWC group design standards without reservations,” and the other three 
studies meet WWC group design standards with reservations.” Study designs are 
noted in Table C.3 and subsequent tables as randomized controlled trials (RCTs) or 
quasi-experimental designs (QEDs). 


Across the five studies,*°* there were findings in two proximal outcome domains 
(Table C.3). Three distal outcome domains were also relevant for this 
recommendation, but this recommendation focused on proximal outcome domains 
only. 


Evidence from all five studies provides a direct test of the recommendation, as 
positive behavioral expectations are a major component of the interventions. 


e In Bradshaw et al. (2010), the intervention consisted of a seven-step procedure 
for implementing school-wide positive behavioral intervention supports 
(SWPBIS). 

e In Pas et al. (2019), the intervention consisted of providing schools with SWBPIS 
training and implementation support, which consisted of initial and booster 
trainings, a 3-year commitment to implement SWPBIS within schools, and a 
four- to six-person SWBPIS team. 

e In Horner et al. (2018), the intervention consisted of implementing a positive 
behavioral intervention and problem-solving team that was responsible for 
precisely defining problems, setting goals related to the problem, selecting 
contextually appropriate solutions, and developing an action plan. 

e In Berg (2018), the School-wide (SW) Attendance and Truancy Intervention 
(ATI-UP) intervention consisted of five components focused on defining, 
publicizing, and reinforcing attendance expectations. 
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e In Ottmar et al. (2013), the Responsive Classroom (RC) intervention consisted of 
implementing nine key practices with positive behavioral expectations over a 2- 
year period. 
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TABLE C.3: Studies Informing Recommendation 1: Implement school-wide procedures for defining, 
teaching, and acknowledging a small set (e.g., 3-5) of positive behavioral expectations 


Outcome Domain 


Study Participants? Setting Intervention Condition Comparison Condition an Wwe 
Calculated Effect 
Size? 
Berg (2018) 27 public schools Elementary schools across 15 | School-wide (SW) Attendance and Truancy _ Business-as-usual: Proximal Outcome 
districts in Eugene, Oregon. Intervention (ATI-UP): Comparison group members Domains 
RCT Student Developed based on critical features of the continued business-as-usual 
characteristics: Multi-Tier System of Supports (MTSS) practices that addressed Compliant student 
Meets WWC °63% White (Non- model to increase average daily attendance absenteeism. All schools were behavior: 
group design Hispanic) and reduce the number of students who already implementing SW-PBIS g=0.096 
standards with °3% American are chronically absent by focusing on Tier1 | with varying levels of fidelity. 
reservations Indian prevention strategies. The intervention had 
2.5% Asian five components: Some comparison schools had 
1.5% Black (1) schools publicize the importance of existing practices that they 
°4.5% two or more attendance; continued to implement. For 
races (2) schools establish attendance goals and example, one of the control 
°25% Hispanic acknowledge improvements; schools had an attendance 
°49% female (3) staff provide an informal and formal coordinator who connected 
°60% eligible for focus on attendance; with parents at early signs of 
free or reduced (4) schools communicate with parents and attendance problems. 
lunch provide ways to engage with the school; 
16.5% English- and 
language learners (5) schools use motivation systems to 
°13.5% received generate enthusiasm. 
special education 
services 
Bradshaw et 37 public schools Elementary schools across5 | SW-PBIS: Business-as-usual: Proximal Outcome 
al. (2010) (consisting of suburban and rural school The intervention was implemented by Comparison group members Domains 
12,344 students) districts in Maryland. following seven steps: continued business-as-usual 
RCT (1) Forming a SW-PBIS team that included practices with assurances that Compliant student 
Student five to six teachers and an administrator. they would not conduct any SW- | behavior: 
Meets WWC characteristics: The team attended a 2-day summer PBIS training for 4 years. g=0.12 
group design Enrolled in K-2 training followed by an annual 2-day 
standards °52.9% male booster training; Student social 
without °45.1% African (2) Receiving onsite support and technical emotional 
reservations American assistance from a trained behavior support functioning: 
°46.1% White coach on at least a monthly basis; g=0.07 
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Participants? 


Setting 


Intervention Condition 


Comparison Condition 


Outcome Domain 
and WWC- 
Calculated Effect 
Size> 


°49% received free 


(3) Establishing 3 to 5 expectations for 


or reduced-price positive student behavior, which were Distal Outcome 
meals posted around the school and were known Domains 
12.9% received to staff and students; 
special education (4) Developing lesson plans defining General 
services behavioral expectations for teaching mathematics 
students at the beginning of the school year achievement: 
and at least once a month thereafter; £=0.03 
(5) Developing, consistently using, and 
reinforcing a school-wide system to reward General literacy 
students who exhibit the expected positive achievement: 
behavior; g=0.05 
(6) Agreeing on what constitutes a 
behavioral violation, and students Primary school 
receiving consistent consequences for academic 
disciplinary infractions; and achievement: 
(7) Developing a formal system to collect, g=0.00 
analyze, and use disciplinary data for data- 
based decision-making. 
Horner et al. 38 elementary Elementary schools in North | Team-Initiated Problem Solving (TIPS): Waitlisted control group: Proximal Outcome 
(2018) schools Carolina and Oregon that TIPS involves precisely defining problems, | Members of the comparison Domains 
implemented PBIS for at setting goals related to the problem, group used business-as-usual 
RCT Student least a year withateamthat | selecting contextually appropriate practices. Compliant student 
characteristics: met at least once a month, solutions, developing an action plan, behavior: 
Meets WWC °47.3% White and that had used the identifying ways to gather fidelity and g=0.56 
group design 23.2% African School-Wide Information outcome data, analyzing those data, and 
standards American System (SWIS) in the using what is learned from the data Distal Outcome 
without 22.8% Hispanic previous 6 months. analysis to refine the action plans. PBIS Domains 
reservations °0.7% American teams in treatment schools received 
Indian training on the TIPS model from district General 
e1.7% Asian PBIS coaches. mathematics 
°4.3% multiple achievement: 
races g=0.01 
58.6% eligible for 
free or reduced- General literacy 
price lunch achievement: 
£=0.05 
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Participants? 


Setting 


Intervention Condition 


Comparison Condition 


Outcome Domain 
and WWC- 
Calculated Effect 


Size> 


Ottmar et al. 24 schools A “mid-Atlantic” public Responsive Classroom (RC): Waitlisted control group: Distal Outcome 
(2013) (consisting of 88 school district. RC consists of 9 key practices implemented | Members of the comparison Domains 
teachers and 2,904 over 2 years. group were waitlisted and 
QED students) continued with business-as- General 
The first year consists of Morning Meeting, usual practices. mathematics 
Meets WWC Student Rule Creation, Interactive Modeling, achievement: 
group design characteristics: Positive Teacher Language, and Logical £=-0.058 
standards with °41% White Consequences. 
reservations °4% African General literacy 
American The second year consists of Guided achievement: 
2% Asian Discovery, Academic Choice, Classroom § =-0.027 
°4% Hispanic Organization, and Collaborative Problem 
°5% Other Solving. 
°28% English- 
language learners 
Pas et al. 859 public Schools selected from across | SW-PBIS: Business-as-usual: Proximal Outcome 
(2019) elementary, Maryland’s 24 public school Schools received SW-PBIS training and Members of the comparison Domains 
middle, and high districts. implementation support. Initial and group did not receive SW-PBIS 
QED schools booster trainings were 2 days long and training and implementation. Compliant student 
required schools to make a 3-year behavior: 
Meets WWC commitment to implementing SW-PBIS and g=0.07 
group design identifying a four- to six-person team to 
standards with attend training. These teams provided the Distal Outcome 
reservations schools with ongoing supports. Domains 
General 
mathematics 
achievement: 
£=0.23 
General literacy 
achievement: 
g=0.01 


Notes: Each row in this table represents a study, as defined by the WWC. QED = quasi-experimental design; RCT = randomized controlled trial. 
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4Sample size represents the maximum number of participants in the study. In some studies, the number of participants varied across the 
outcome measures. 

bEffect sizes presented are from the outcome closest to the end of the intervention. For brevity, only the domain average effect size and 
statistical significance are reported in this table. 

* = Statistically significant at the .05 level. 
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Recommendation 2: Implement School-Wide Procedures to Ensure 
that Consequences for Problem Behavior (a) Prevent Escalation, (b) 
Interrupt and/or Redirect Problem Behavior to Expected Behavior, 
and (c) Minimize Inadvertently Rewarding Problem Behavior. 


Recommendation 2 was informed by five studies of interventions with procedures and 
practices to reduce problem behaviors. Two of the studies meet WWC group design 
standards without reservations,” and the other three studies meet WWC group 
design standards with reservations.” 


Evidence from all five studies provides a direct test of the recommendation, as 
positive behavioral expectations are a major component of the interventions. 


e In Bradshaw et al. (2010), the intervention consisted of a seven-step procedure 
for implementing school-wide positive behavioral intervention supports 
(SWPBIS). 

e In Pas et al. (2019), the intervention consisted of providing schools with SWBPIS 
training and implementation support, which consisted of initial and booster 
trainings, a 3-year commitment to implement SWPBIS within schools, and a 
four- to six-person SWBPIS team. 

e In Horner et al. (2018), the intervention consisted of implementing a positive 
behavioral intervention and problem-solving team that was responsible for 
precisely defining problems, setting goals related to the problem, selecting 
contextually appropriate solutions, and developing an action plan. 

e In Berg (2018), the School-wide (SW) Attendance and Truancy Intervention 
(ATI-UP) intervention consisted of five components focused on defining, 
publicizing, and reinforcing attendance expectations. 

e In Ottmar et al. (2013), the Responsive Classroom (RC) intervention consisted of 
implementing nine key practices with positive behavioral expectations over a 2- 
year period. 
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TABLE C.4: Studies Informing Recommendation 2: Implement school-wide procedures to ensure that 
consequences for problem behavior (a) prevent escalation, (b) interrupt and/or redirect problem behavior to 
expected behavior, and (c) minimize inadvertently rewarding problem behavior 


Participants* 


Setting 


Intervention Condition 


Comparison Condition 


Outcome Domain 
and WWC- 
Calculated Effect 
Size? 


Berg (2018) 27 public schools Elementary schools across 15 | School-wide (SW) Attendance and Truancy _ Business-as-usual: Proximal Outcome 
districts in Eugene, Oregon. Intervention (ATI-UP): Comparison group members Domains 
RCT Student Developed based on critical features of the | continued business-as-usual 
characteristics: Multi-Tier System of Supports (MTSS) practices that addressed Compliant student 
Meets WWC °63% White (Non- model to increase average daily attendance absenteeism. All schools were behavior: 
group design Hispanic) and reduce the number of students who already implementing SW-PBIS g=0.096 
standards with °3% American are chronically absent by focusing on Tier 1 | with varying levels of fidelity. 
reservations Indian prevention strategies, the intervention had 
2.5% Asian five components: Some comparison schools had 
°1.5% Black (1) schools publicize the importance of existing practices that they 
°4.5% two or more attendance; continued to implement. For 
races (2) schools establish attendance goals and example, one of the control 
°25% Hispanic acknowledge improvements; schools had an attendance 
°49% female (3) staff provide an informal and formal coordinator who connected 
°60% eligible for focus on attendance; with parents at early signs of 
free or reduced (4) schools communicate with parents and attendance problems. 
lunch provide ways to engage with the school; 
16.5% English- and 
language learners (5) schools use motivation systems to 
°13.5% received generate enthusiasm. 
special education 
services 
Bradshaw et 37 public schools Elementary schools across5 | SW-PBIS: Business-as-usual: Proximal Outcome 
al. (2010) (consisting of suburban and rural school The intervention was implemented by Comparison group members Domains 
12,344 students) districts in Maryland. following seven steps: continued business-as-usual 
RCT (1) Forming a SW-PBIS team that included practices with assurances that Compliant student 
Student five to six teachers and an administrator. they would not conduct any SW- | behavior: 
Meets WWC characteristics: The team attended a 2-day summer PBIS training for 4 years. g=0.12 
group design Enrolled in K-2 training followed by an annual 2-day 
standards 052.9% male booster training; Student social 
without °45.1% African emotional 
reservations American functioning: 
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Participants? 


Setting 


Intervention Condition 


Comparison Condition 


Outcome Domain 
and WWC- 
Calculated Effect 
Size> 


°46.1% White (2) Receiving onsite support and technical £=0.07 
°49% received free assistance from a trained behavior support 
or reduced-price coach on at least a monthly basis; Distal Outcome 
meals (3) Establishing 3 to 5 expectations for Domains 
12.9% received positive student behavior, which were 
special education posted around the school and were known General 
services to staff and students; mathematics 
(4) Developing lesson plans defining achievement: 
behavioral expectations for teaching g=0.03 
students at the beginning of the school year 
and at least once a month thereafter; General literacy 
(5) Developing, consistently using, and achievement: 
reinforcing a school-wide system to reward g=0.05 
students who exhibit the expected positive 
behavior; Primary school 
(6) Agreeing on what constitutes a academic 
behavioral violation, and students achievement: 
receiving consistent consequences for £=0.00 
disciplinary infractions; and 
(7) Developing a formal system to collect, 
analyze, and use disciplinary data for data- 
based decision-making. 
Horner et al. 38 elementary Elementary schools in North | Team-Initiated Problem Solving (TIPS): Waitlisted control group: Proximal Outcome 
(2018) schools Carolina and Oregon that TIPS involves precisely defining problems, | Members of the comparison Domains 
implemented PBIS for at setting goals related to the problem, group used business-as-usual 
RCT Student least a year withateamthat | selecting contextually appropriate practices but received the TIPS Compliant student 
characteristics: met at least once a month, solutions, developing an action plan, training prior to the last data behavior: 
Meets WWC °47.3% White and that had used the identifying ways to gather fidelity and collection period. g=0.56 
group design 23.2% African School-Wide Information outcome data, analyzing those data, and 
standards American System (SWIS) in the using what is learned from the data Distal Outcome 
without 22.8% Hispanic previous 6 months. analysis to refine the action plans. PBIS Domains 
reservations °0.7% American teams in treatment schools received 
Indian training on the TIPS model from district General 
1.7% Asian PBIS coaches. mathematics 
4.3% multiple achievement: 
races g=0.01 
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Participants? 


Setting 


Intervention Condition 


Comparison Condition 


Outcome Domain 
and WWC- 
Calculated Effect 
Size> 


58.6% eligible for General literacy 
free or reduced- achievement: 
price lunch £=0.05 
Ottmar et al. 24 schools A “mid-Atlantic” public Responsive Classroom (RC): Waitlisted control group: Distal Outcome 
(2013) (consisting of 88 school district. RC consists of 9 key practices implemented | Members of the comparison Domains 
teachers and 2,904 over 2 years. group were waitlisted and 
QED students) continued with business-as- General 
The first year consists of Morning Meeting, usual practices. mathematics 
Meets WWC Student Rule Creation, Interactive Modeling, achievement: 
group design characteristics: Positive Teacher Language, and Logical g=-0.058 
standards with °41% White Consequences. 
reservations °4% African General literacy 
American The second year consists of Guided achievement: 
°2% Asian Discovery, Academic Choice, Classroom g=-0.027 
°4% Hispanic Organization, and Collaborative Problem 
°5% Other Solving. 
°28% English- 
language learners 
Pas et al. 859 public Schools selected from across | SW-PBIS: Business-as-usual: Proximal Outcome 
(2019) elementary, Maryland’s 24 public school | Schools received SW-PBIS training and Members of the comparison Domains 
middle, and high districts. implementation support. Training was group did not receive SW-PBIS 
QED schools provided by the federal Office for Special training and implementation. Compliant student 
Education Programs. Initial and booster behavior: 
Meets WWC trainings were 2 days long and required g=0.07 
group design schools to make a 3-year commitment to 
standards with implementing SW-PBIS and identifying a Distal Outcome 
reservations four- to six-person team to attend training. Domains 
These teams provided the schools with 
ongoing supports. General 
mathematics 
achievement: 
g=0.23 
General literacy 
achievement: 
g=0.01 
Promoting Social and Behavioral Success for Learning in Elementary Schools 130 


Notes: Each row in this table represents a study, as defined by the WWC. QED = quasi-experimental design; RCT = randomized controlled trial. 
4Sample size represents the maximum number of participants in the study. In some studies, the number of participants varied across the 
outcome measures. 


>Effect sizes presented are from the outcome closest to the end of the intervention. For brevity, only the domain average effect size and 
statistical significance are reported in this table. 


* = Statistically significant at the .05 level. 
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Recommendation 3: Use Coaching to Support Implementation of 
Evidence-Based Instructional and Classroom Management Strategies. 


Recommendation 3 was informed by three studies of interventions with coaching 
components. Two of the studies meet WWC group design standards without 
reservations,*° and the other study meets WWC group design standards with 
reservations.*6 


Evidence from all three studies provides a direct test of the recommendation, as 
coaching is a major component of the interventions. 


e In Horner et al. (2018), the intervention consisted of PBIS teams receiving 
training on Team-Initiated Problem Solving (TIPS), and then implementing the 
TIPS model. The model’s core components consist of precisely defining 
problems, setting goals related to problems, selecting contextually appropriate 
solutions, developing an action plan, identifying ways to gather fidelity and 
outcome data, analyzing those data, and using what is learned from the data 
analysis to refine action plans. 

e In Bradshaw et al. (2018), the intervention consisted of implementing the 
Double Check, which consists of three core components: (1) augmentations to 
the Tier 1 elements of SWPBIS; (2) a set of five 60-minute professional 
development trainings addressing five core domains of culturally responsive 
practices; and (3) individual classroom coaching using an adapted version of 
the Classroom Check-Up (CCU), which utilized structured problem-solving to 
facilitate changes in teacher practices. 

e In Fabiano et al. (2018), the intervention consisted of teacher coaching 
supported by formative assessment using the Classroom Strategies Assessment 
System (CSAS), a multidimensional classroom observation instrument for the 
assessment and intervention of teachers’ classroom practices. 
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TABLE C.5: Studies Informing Recommendation 3: Use coaching to support implementation of evidence- 
based instructional and classroom management strategies 


Outcome Domain 


Study Participants? Setting Intervention Condition Comparison Condition and 
AWA WOR erat tre 
Effect Size? 
Bradshaw et 158 teachers (104 6 elementary schools and6 | Double Check Coaching: Business-as-usual: Proximal Outcome 
al. (2018) middle school and middle schools in a single The intervention included 3 core Members of the control group Domains 
54 elementary district in Maryland. components: implemented the following 
RCT schools) (1) augmentations to the Tier 1 elements of components: Compliant student 
SWPBIS; (1) augmentations to the Tier 1 behavior: 
Meets WWC Teacher (2) a set of five 60-minute professional elements of SW-PBIS; and g=0.30 
group design characteristics: development trainings addressing five core | 2) a set of five 60-minute 
standards °85.4% female domains of culturally responsive practices; | professional development Educator 
without °75.3% White and trainings addressing five core instructional 
reservations 12.0% Black (3) individual classroom coaching using an domains of culturally practice: 
°8.9% other race adapted version of the Classroom Check-Up | responsive practices. g=0.24 
33.5% early career (CCU), which utilized structured problem- 
(20 to 30 years old) solving to facilitate changes in teacher Educator discipline 
°65.8% middle practices. practice: 
school teachers g=0.45* 
Fabiano et al. | 89 elementary Elementary general Teacher coaching supported by formative Waitlisted control group: Proximal Outcome 
(2018) general education education classroom assessment: Members of the comparison Domains 
teachers teachers across K-5 grades __ Teachers received four 30-minute weekly group used business-as-usual 
RCT in New Jersey and New sessions of coaching, in which coaches practices. Educator 
Teacher York. provided support to teachers in discussing instructional 
Meets WWC characteristics: practice needs, reviewing classroom practice: 
group design 94.4% female observational data, setting goals to use g=0.23 
standards with | *95% White strategies, implementing plans, and 
reservations °3% Asian monitoring progress. Educator discipline 
°1.5% Black practice: 
1% Hispanic/Latino Coaching sessions were combined with the g=0.54* 
Classroom Strategies Assessment System 
(CSAS), a multidimensional classroom 
observation instrument for the assessment 
of classroom practices. 
Horner et al. 38 elementary Elementary schools in Team-Initiated Problem Solving (TIPS): Waitlisted control group: Proximal Outcome 
(2018) schools North Carolina and Oregon Domains 
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Participants? 


Setting 


Intervention Condition 


Comparison Condition 


Outcome Domain 
and 
WWC-Calculated 


that implemented PBIS for 


TIPS involves precisely defining problems, 


Members of the comparison 


Effect Size” 


RCT Student at least a year with a team setting goals related to the problem, group used business-as-usual Compliant student 
characteristics: that met at least once a selecting contextually appropriate practices. behavior: 
Meets WWC °47.3% White month, and that had used solutions, developing an action plan, £=0.56 
group design 23.2% African the School-Wide identifying ways to gather fidelity and 
standards American Information System (SWIS) | outcome data, analyzing those data, and Distal Outcome 
without 22.8% Hispanic in the previous 6 months. using what is learned from the data analysis Domains 
reservations °0.7% American to refine the action plans. PBIS teams in 
Indian treatment schools received training on the General mathematics 
°1.7% Asian TIPS model from district PBIS coaches. achievement: 
4.3% multiple g=0.01 
races 
58.6% eligible for General literacy 
free or reduced- achievement: 
price lunch g=0.05 


Notes: Each row in this table represents a study, as defined by the WWC. QED = quasi-experimental design; RCT = randomized controlled trial. 
4Sample size represents the maximum number of participants in the study. In some studies, the number of participants varied across the 
outcome measures. 
> Effect sizes presented are from the outcome closest to the end of the intervention. For brevity, only the domain average effect size and 
statistical significance are reported in this table. 
* = Statistically significant at the .05 level. 


Promoting Social and Behavioral Success for Learning in Elementary Schools 


134 


Recommendation 4: Collect, Summarize, and Use Fidelity and Student 
Outcome Data at All Levels for Iterative Decision-Making and Problem- 
Solving by Stakeholders. 


Recommendation 4 was informed by five studies of interventions with components 
related to collecting, summarizing, and using fidelity and student outcome data. 
Three of the studies meet WWC group design standards without reservations,” and 
the other two studies meet WWC group design standards with reservations.?° 


Evidence from all five studies provides a direct test of the recommendation, as 
collecting, summarizing, and using fidelity and student outcome data are a major 
component of the interventions. 


e In Bradshaw et al. (2010), the intervention included the development of a 
formal system to collect, analyze, and use disciplinary data for data-based 
decision-making regarding outcomes and program implementation. 

e In Horner et al. (2018), the intervention included identifying ways to gather 
fidelity and outcome data, analyzing those data, and using what was learned 
from the data analysis to refine action plans. 

e In Bradshaw et al. (2018), the intervention included a structured, data-based 
problem-solving process used to facilitate changes in teacher practices. 

e In Fabiano et al. (2018), the intervention included coaches reviewing classroom 
observational data with educators and helping to set educator goals based on 
the data. 

e In Pas et al. (2018), the intervention included the adoption of data systems that 
supported consistent collection and analysis of implementation and outcome 
data. 
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TABLE C.6: Studies Informing Recommendation 4: Collect, summarize, and use fidelity and student outcome 
data at all levels for iterative decision-making and problem-solving by stakeholders 


Study 


Participants? 


Setting 


Intervention Condition 


Comparison Condition 


Outcome Domain 


and WWC-Calculated 


Bradshaw et 
al. (2010) 


RCT 


Meets WWC 
group design 
standards 
without 
reservations 


37 public schools 
(consisting of 12,344 
students) 


Student 
characteristics: 
eEnrolled in K-2 
052.9% male 
045.1% African 
American 
°46.1% White 
°49% received free 
or reduced-price 
meals 

12.9% received 


Elementary schools across 5 
suburban and rural school 
districts in Maryland. 


SW-PBIS: 

The intervention was implemented by 
following seven steps: 

(1) Forming a SW-PBIS team that included 
five to six teachers and an administrator. 
The SWPBIS team attended an initial 2-day 
summer training co-led by one of the 
SWPBIS developers followed by an annual 
2-day booster training; 

(2) Receiving onsite support and technical 
assistance from a trained behavior support 
coach on at least a monthly basis; 

(3) Establishing 3 to 5 expectations for 
positive student behavior, which were 
posted around the school and were known 


Business-as-usual: 


Comparison group members 
continued business-as-usual 


practices with assurances 


that they would not conduct 


any SW-PBIS training for 4 
years. 


Effect Size” 
Proximal Outcome 
Domains 


Compliant student 
behavior: 
g=0.12 


Student social 
emotional functioning: 


g=0.07 


Distal Outcome 
Domains 


General mathematics 


district in Maryland. 


components: 


special education to staff and students; achievement: 
services (4) Developing lesson plans defining g=0.03 
behavioral expectations for teaching 
students at the beginning of the school year General literacy 
and at least once a month thereafter; achievement: 
(5) Developing, consistently using, and g=0.05 
reinforcing a school-wide system to reward 
students who exhibit the expected positive Primary school 
behavior; academic 
(6) Agreeing on what constitutes a achievement: 
behavioral violation, and students g=0.00 
receiving consistent consequences for 
disciplinary infractions; and 
(7) Developing a formal system to collect, 
analyze, and use disciplinary data for data- 
based decision-making. 
Bradshaw et 158 teachers (104 6 elementary schools and6 | Double Check Coaching: Business-as-usual: Proximal Outcome 
al. (2018) middle school and middle schools in a single The intervention included 3 core Domains 
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Participants? 


Setting 


Intervention Condition 


Comparison Condition 


Outcome Domain 
and WWC-Calculated 
Effect Size> 


RCT 


Meets WWC 
group design 
standards 
without 
reservations 


54 elementary 
schools) 


Teacher 
characteristics: 
°85.4% female 
°75.3% White 
12.0% Black 

°8.9% other race 
33.5% early career 
(20 to 30 years old) 
°65.8% middle 


(1) augmentations to the Tier 1 elements of 
SWPBIS; 

(2) a set of five 60-minute professional 
development trainings addressing five core 
domains of culturally responsive practices; 
and 

(3) individual classroom coaching using an 
adapted version of the Classroom Check-Up 
(CCU), which utilized structured problem- 
solving to facilitate changes in teacher 
practices. 


Members of the control 
group implemented the 
following components: 

(1) augmentations to the Tier 
1 elements of SW-PBIS; and 
(2) a set of five 60-minute 
professional development 
trainings addressing five core 
domains of culturally 
responsive practices. 


Compliant student 
behavior: 
g=0.30 


Educator instructional 
practice (individual- 
level): 

g=0.24 


Educator discipline 
practice (individual- 
level): 


school teachers g=0.45* 
Fabiano et al. | 89 elementary Elementary general Teacher coaching supported by formative Waitlisted control group: Proximal Outcome 
(2018) general education education classroom assessment: Members of the comparison | Domains 
teachers teachers across K-5 grades Teachers received four 30-minute weekly group used business-as-usual 
RCT in New Jersey and New sessions of coaching, in which coaches practices. Educator instructional 
Teacher York. provided support to teachers in discussing practice: 
Meets WWC characteristics: practice needs, reviewing classroom g=0.23 
group design °94.4% female observational data, setting goals to use 
standards with | °95% White strategies, implementing plans, and Educator discipline 
reservations °3% Asian monitoring progress. practice: 
°1.5% Black g=0.54* 
°1% Hispanic/Latino Coaching sessions were combined with the 
Classroom Strategies Assessment System 
(CSAS), a multidimensional classroom 
observation instrument for the assessment 
of and intervention in teachers’ classroom 
practices. 
Horner et al. 38 elementary Elementary schools in North | Team-Initiated Problem Solving (TIPS): Waitlisted control group: Proximal Outcome 
(2018) schools Carolina and Oregon that TIPS involves precisely defining problems, | Members ofthe comparison | Domains 
implemented PBIS for at setting goals related to the problem, group used business-as-usual 
RCT Student least a year with ateamthat — selecting contextually appropriate practices. Compliant student 
characteristics: met at least once a month, solutions, developing an action plan, behavior: 
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Outcome Domain 


Participants? Setting Intervention Condition Comparison Condition PVC WAL WOR Or (alirlacre| 
Effect Size” 
Meets WWC °47.3% White and that had used the identifying ways to gather fidelity and g=0.56 
group design 23.2% African School-Wide Information outcome data, analyzing those data, and 
standards American System (SWIS) in the using what is learned from the data Distal Outcome 
without 22.8% Hispanic previous 6 months. analysis to refine the action plans. PBIS Domains 
reservations °0.7% American teams in treatment schools received 
Indian training on the TIPS model from district General mathematics 
°1.7% Asian PBIS coaches. achievement: 
°4.3% multiple g=0.01 
races 
°58.6% eligible for General literacy 
free or reduced- achievement: 
price lunch £=0.05 
Pas et al. 859 public Schools selected from SW-PBIS: Business-as-usual: Proximal Outcome 
(2019) elementary, across Maryland’s 24 public | Schools received SW-PBIS training and Members of the comparison | Domains 
middle, and high school districts. implementation support. Initial and group did not receive SW- 
QED schools booster trainings were 2 days long and PBIS training and Compliant student 
required schools to make a 3-year implementation. behavior: 
Meets WWC commitment to implementing SW-PBIS and g=0.07 
group design identifying a four- to six-person team to 
standards with attend training. These teams provided the Distal Outcome 
reservations schools with ongoing supports. Domains 
General mathematics 
achievement: 
g=0.23 
General literacy 
achievement: 
g=0.01 


Notes: Each row in this table represents a study, as defined by the WWC. QED = quasi-experimental design; RCT = randomized controlled trial. 
4Sample size represents the maximum number of participants in the study. In some studies, the number of participants varied across the 
outcome measures. 
bEffect sizes presented are from the outcome closest to the end of the intervention. For brevity, only the domain average effect size and 
statistical significance are reported in this table. 
* = Statistically significant at the .05 level. 
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Recommendation 5: Implement the Organizational Systems Needed to 
Support the Initial Adoption and Sustained Use of Effective Practices 
with High Fidelity. 


Recommendation 5 was informed by two studies of interventions with organizational 
systems to support initial adoption and sustained use of positive behavioral practices 
with high fidelity. One study meets WWC group design standards without 
reservations,”°° and the other study meets WWC group design standards with 
reservations.””° 


Evidence from both studies provides a direct test of the recommendation, as 
organizational systems supporting initial adoption and sustained use of positive 
behavioral practices with high fidelity are a major component of the interventions. 


e In Bradshaw et al. (2010), the intervention included state-level implementation 
support via an SW-PBIS training and support system led and coordinated by the 
state. 

e In Pas et al. (2019), the intervention included statewide training and coaching, 
ongoing supports throughout the school year, and statewide collection of 
school-level implementation data. 
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TABLE C.7: Studies Informing Recommendation 5: Implement the organizational systems needed to support 
the initial adoption and sustained use of effective practices with high fidelity 


Outcome 


Study 


Bradshaw et al. 
(2010) 


RCT 


Meets WWC 
group design 
standards 
without 
reservations 


Participants* 


37 public schools 
(consisting of 
12,344 students) 


Student 
characteristics: 
eEnrolled in K-2 
52.9% male 
045.1% African 
American 

°46.1% White 
°49% received free 
or reduced-price 
meals 

12.9% received 
special education 
services 


Elementary schools 
across 5 suburban 
and rural school 
districts in 
Maryland. 


Intervention Condition 


SW-PBIS: 

The intervention was implemented by following 
seven steps: 

(1) Forming a SW-PBIS team that included five to six 
teachers and an administrator. The team attended a 
2-day summer training followed by an annual 2-day 
booster training; 

(2) Receiving onsite support and technical assistance 
from a trained behavior support coach on at least a 
monthly basis; 

(3) Establishing 3 to 5 expectations for positive 
student behavior, which were posted around the 
school and were known to staff and students; 

(4) Developing lesson plans defining behavioral 
expectations for teaching students at the beginning of 
the school year and at least once a month thereafter; 
(5) Developing, consistently using, and reinforcing a 
school-wide system to reward students who exhibit 
the expected positive behavior; 

(6) Agreeing on what constitutes a behavioral 
violation, and students receiving consistent 
consequences for disciplinary infractions; and 

(7) Developing a formal system to collect, analyze, 
and use disciplinary data for data-based decision- 
making. 


Comparison Condition 


Business-as-usual: 

Comparison group members 
continued business-as-usual 
practices with assurances that 
they would not conduct any SW- 
PBIS training for 4 years. 


Domain and 
WWC- 
Calculated 
Effect Size> 
Proximal 
Outcome 
Domains 


Compliant 
student 
behavior: 
g=0.12 


Student social 
emotional 
functioning: 
g=0.07 


Distal Outcome 
Domains 


General 
mathematics 
achievement: 
g=0.03 


General literacy 
achievement: 
£=0.05 


Primary school 
academic 
achievement: 
g=0.00 
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Outcome 
Domain and 


Participants? Setting Intervention Condition Comparison Condition WWC- 
Calculated 


Effect Size? 
Pas et al. (2019) | 859 public Schools selected SW-PBIS: Business-as-usual: Proximal 
elementary, from across Schools received SW-PBIS training and Members of the comparison Outcome 
QED middle, and high Maryland’s 24 implementation support. Initial and booster trainings | group did not receive SW-PBIS Domains 
schools public school were 2 days long and required schools to make a 3- training and implementation. 
Meets WWC districts. year commitment to implementing SW-PBIS and Compliant 
group design identifying a four- to six-person team to attend student 
standards with training. These teams provided the schools with behavior: 
reservations ongoing supports. g=0.07 


Distal Outcome 
Domains 


General 
mathematics 
achievement: 
£=0.23 


General literacy 
achievement: 
g=0.01 

Notes: Each row in this table represents a study, as defined by the WWC. QED = quasi-experimental design; RCT = randomized controlled trial. 
4Sample size represents the maximum number of participants in the study. In some studies, the number of participants varied across the 
outcome measures. 

bEffect sizes presented are from the outcome closest to the end of the intervention. For brevity, only the domain average effect size and 
statistical significance are reported in this table. 

* = Statistically significant at the .05 level. 
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